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Abstract 


This  study  explores  the  feasibility  of  using  statis¬ 
tical  sampling  techniques  in  lieu  of  a  census  to  collect  Air 
Force  maintenance  (MDC)  data.  A  practical  sampling 
methodology  is  identified  and  the  sample  size  required  to 
collect  data  with  a  specified  degree  of  statistical  pre¬ 
cision  is  iLlustrated.  The  variable  cost  of  MDC  data  col¬ 
lection  and  processing  is  also  identified.  Using  the  F-16A 
Fire  Control  System  on  the  aircraft  at  one  base  as  an 
example,  the  potential  cost  and  effort  savings  resulting 
from  sampling  are  evaluated. 

The  sampling  concept  is  based  on  a  simple  random  sam¬ 
ple  of  aircraft,  by  serial  number,  with  full  data  collected 
on  all  aircraft  in  the  sample.  The  sampling  plan  is 
designed  to  estimate  the  base  level  monthly  total  unsched¬ 
uled  maintenance  manhours  at  the  two  digit  work  unit  code 
level,  with  10  percent  relative  precision  and  90  percent 
confidence.  The  methodology  used  to  estimate  the  variable 
cost  of  collecting  and  processing  MDC  data  records  is 
limited  to  base  and  Air  Force  Logistics  Command  ( AFLC ) 


vii 


levels.  Base  level  costs  considered  are  the  opportunity 
cost  of  a  maintenance  technician's  time  to  enter  one  MDC 
record  into  an  automated  system  terminal,  and  the  cost  of 
computer  processing  and  transmission  of  data  to  AFLC.  AFLC 
costs  considered  are  the  machine  time  charges  assessed 
against  the  0056  Product  Performance  System. 

In  the  single  system  studied,  the  variability  in 
monthly  unscheduled  manhours  per  aircraft  was  found  to  be 
high.  The  resulting  sample  size  required  to  estimate  man¬ 
hours  with  the  desired  degree  of  statistical  accuracy,  based 
on  the  greatest  observed  variability  in  historical  data, 
nearly  represents  a  census.  The  variable  cost  of  collecting 
and  processing  MDC  data  is  significant.  However,  unless  a 
sophisticated  technique  can  be  used  to  predict  data 
variability  and  reduce  the  required  sample  size,  the 
potential  cost  and  effort  savings  resulting  from  sampling 
appear  to  be  minimal. 
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A  FEASIBILITY  STUDY  OF  THE  COLLECTION 
OF  UNSCHEDULED  MAINTENANCE  DATA  USING 
STATISTICAL  SAMPLING  TECHNIQUES 


I.  Introduction 


General  Issue 

The  Air  Force  Maintenance  Data  Collection  (MDC)  System 
has  been  the  object  of  much  criticism  in  numerous  studies 
and  reports  during  it's  nearly  thirty  year  history.  The 
major  complaints  associated  with  MDC  are  that  the  system 
contains  inaccurate  and  incomplete  data;  the  voluminous  data 
require  a  tremendous  effort  to  collect  and  process;  and  the 
feedback  of  useful  data  to  management  at  all  levels  is  un¬ 
timely  and  of  questionable  value  and  accuracy.  In  addition, 
the  inability  of  field  maintenance  personnel  to  directly 
benefit  from  the  data  provides  no  incentive  to  collect  accu¬ 
rate  data.  Questions  have  also  been  raised  about  the  need 
to  collect  the  volume  of  data  currently  processed  by  the 
system  and  whether  the  data  meet  the  needs  of  MDC  system 
users.  Additionally,  the  MDC  system  does  not  provide  ade¬ 
quate  feedback  of  the  type  of  data  needed  to  accurately 
evaluate  the  reliability  and  maintainability  (R  &  M)  per¬ 
formance  of  fielded  systems  (25:343-345;  29:IV-24).  The 
specific  problems  associated  with  the  MDC  system  have  been 
identified  in  several  studies  during  the  past  decade 
(22:44-50) . 
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These  problems  are  compounded  by  the  use  of  MOC  data  in 
other  logistics  management  information  systems.  For  exam¬ 
ple,  the  Visibility  and  Management  of  Operating  and  Support 
Costs  Program  (VAMOSC) ,  the  Maintenance  and  Operational  Data 
Access  System  (MODAS) ,  and  the  Product  Performance  System 
(D056)  all  receive  data  from  the  MDC  system.  Data  provided 
by  these  systems  are  used  to  determine  operating,  support, 
and  life  cycle  costs;  to  provide  limited  feedback  on  relia¬ 
bility  and  maintainability  of  fielded  systems  to  the  Air 
Force  and  defense  contractors;  and  to  develop  cost  and  per¬ 
formance  baselines  used  in  the  evaluation  of  new  system 
acquisitions  (12:2.1-2.2).  In  addition,  MDC  data  are  used 
to  develop  data  bases  for  Logistics  Composite  Modeling 
(LCOM)  simulations,  the  results  of  which  are  used  to  deter¬ 
mine  maintenance  manpower  requirements  and  authorizations 
(10).  Needless  to  say,  the  effectiveness  of  decisions  based 
in  whole  or  in  part  on  MDC  data  depends  on  the  accuracy  and 
timeliness  of  the  data  collection  system. 

The  inability  of  the  MDC  system  to  provide  adequate 
reliability  and  maintainability  feedback  data  led  to  the 
development  of  an  additional  data  system  to  support  the 
F-16  System  Program  Office  at  Wr ight-Patterson  AFB,  Ohio 
(22:18) .  The  F-16  Central  Data  System  (CDS)  was  developed 
to  automate  the  collection  of  reliability  and  maintainabil¬ 
ity  data  and  to  provide  the  capability  to  track  and  portray 
statistics  and  trends  of  this  data  for  the  F-16  and  its  avi- 
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onics  automatic  test  equipment. 

In  1975,  the  Air  Force  began  a  test  program,  the  Auto¬ 
mated  Maintenance  System  (AMS),  designed  to  evaluate  the 
automation  of  selected  maintenance  information  and  control 
processes  and  to  establish  the  value  of  the  concept,  for 
implementation  throughout  the  Air  Force  (22:24).  Among  the 
automated  processes  was  the  on-line  collection  and  retrieval 
of  MDC  data.  The  AMS  system  should  virtually  eliminate  in¬ 
accurate  and  incomplete  data  collection,  reduce  the  ef£ort 
required  to  collect  and  process  the  high  volume  of  MDC  data, 
and  provide  timely  access  to  and  feedback  of  information 
needed  to  manage  and  control  maintenance  operations.  The 
AMS  system  provides  a  feasible  solution  to  many  of  the  prob- 
ems  associated  with  the  MDC  system  in  the  past.  The  suc¬ 
cess  of  the  AMS  test  program  led  to  a  decision  to  test  a 
similar  system,  the  Core  Automated  Maintenance  System 
(CAMS) ,  at  several  Air  Force  bases  during  1985.  If  the  tests 
are  successful,  this  system  is  planned  to  be  installed  at 
all  bases  as  part  of  the  current  Air  Force  Phase  IV  computer 
upgrade  program  (21:16). 

The  Automated  Maintenance  System,  and  the  subsequent 
implementation  of  the  concept  in  CAMS,  does  not  address  two 
of  the  problems  associated  with  the  MDC  system.  It  does  not 
address  the  volume  of  data  collected  relative  to  it's  use¬ 
fulness  as  information,  and  it  does  not  provide  any  improve¬ 
ment  in  the  type  of  data  needed  to  provide  adequate  feedback 
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of  reliability  and  maintainability  information.  The  data 
elements  and  the  volume  in  which  they  will  be  collected  in 
che  CAMS  system  remain  virtually  unchanged  from  the  manual 
data  collection  process  CAMS  replaces  (2:1.1).  These  two 
issues  form  the  basis  for  this  thesis  study. 

To  address  the  first  issue,  it  is  necessary  to  evaluate 
methods  of  reducing  the  volume  of  data  collected,  while 
maintaining  the  ability  to  derive  useful  and  reliable  infor¬ 
mation  from  the  data.  The  second  issue  requires  an  analysis 
of  what  additional  data  is  needed,  followed  by  a  determina¬ 
tion  of  a  method  of  collecting  it.  If  more  MDC  data  are 
collected  than  useful,  and  less  reliability  and  maintain¬ 
ability  data  are  collected  than  needed,  it  should  be  possi¬ 
ble  to  reduce  the  volume  of  MDC  data  collected  and  replace 
it  with  improved  reliability  and  maintainability  data. 

The  best  known  method  of  collecting  a  limited  volume  of 
data  on  a  smaller  number  of  items  in  order  to  provide  infor¬ 
mation  about  a  larger  number  of  like  items  is  statistical 
sampling.  The  most  common  uses  of  statistical  sampling  are 
in  public  opinion  and  election  polling,  in  manufacturing 
quality  control,  and  in  the  field  of  auditing.  There  are 
two  known  instances  where  sampling  has  teen  used  to  collect 
aircraft  maintenance  data.  A  1976  contractor  study,  known 
as  "Project  REALMS :  Recommendations  to  Enhance  the  Air 
Logistics  Maintenance  System,"  recommended  the  application 
of  statistical  sampling  techniques  and  trained  observers  to 
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gather  manhour  data  (22:21).  In  1S78,  based  on  the  Project 
REALMS  study,  the  Air  Force  Logistics  Management  Center 
(AFLMC)  conducted  a  pilot  study  to  test  the  collection  of 
manhour  data  through  the  use  of  work  sampling  methods.  The 
study  concluded  that  the  use  of  the  proposed  work  sampling 
methods  for  routine  data  collection  was  impractical  from  an 
administrative  standpoint  (5:4-2).  In  addition,  a  1979  Air 
Force  Audit  Agency  report  on  tne  AFLMC  pilot  study,  stated 
that  the  proposed  sampling  plan  would  not  satisfy  the  data 
requirements  of  other  information  systems,  and  that  the 
impact  on  other  ongoing  projects  was  not  considered  (1:7-9). 
The  U.  S.  Army  has  successfully  employed  the.  use  of  sampling 
to  collect  maintenance  data  on  equipment  since  1970,  and  on 
aircraft  3ince  1978  (19:1-2).  The  sampling  conducted  by  the 
Army  is  purposive,  rather  than  random  sampling,  which 
implies  that  the  data  collected  may  not  be  truly  representa¬ 
tive  of  the  population.  Purposive,  or  convenience  sampling, 
means  that  the  sample  is  not  chosen  at  random,  such  that 
each  element  of  the  population  stands  an  equal  chance  of 
being  selected.  Therefore,  the  properties  of  inferential 
statistics  cannot  be  used  with  purposive  sampling.  The 
aircraft  maintenance  data  collected  by  the  Army  is  similar, 
although  more  detailed,  than  the  data  collected  by  the  Air 
Force.  The  Arm;/  also  collects  routine  operations  data  in 
conjunction  with  the  maintenance  data. 
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Considering  the  two  previous  uses  of  sampling  to  col¬ 
lect  maintenance  data;  the  improvements  in  information  pro¬ 
cessing  technology;  and  the  need  for  better  reliability  and 
maintainability  data*  it  is  useful  to  re-evaluate  the  use  of 
a  sampling  concept  to  collect  MDC  data.  A  reduction  in  the 
volume  of  MDC  data  collected  could  then  be  used  to  balance 
an  increase  in  the  quality  of  reliability  and  maintainabil¬ 
ity  data  collection. 

Problem  Statement 

The  data  currently  collected  by  the  MDC  system  are 
unquestionably  cf  some  value  in  maintenance  and  logistics 
management;  however,  the  volume  of  data  collected  and  the 
expense  incurred  to  collect  it  may  be  unnecessary  to  provide 
the  information  management  derives  from  the  data  (22).  For 
example,  the  Air  Force  currently  collects  and  processes  over 
23  million  MDC  data  records  annually  (23).  A  1982  Air  Force 
Logistics  Management  Center  study  estimated  the  average 
annual  cost  of  computer  paper,  punch  cards,  keypunch  machine 
maintenance,  and  keypunch  personnel  used  to  collect  and  pro¬ 
cess  MDC  data  at  over  $9  million  (6s 6—7) .  Not  included  in 
this  figure  are  the  costs  of  the  maintenance  technician  who 
collects  the  data,  magnetic  tape  used  to  store  data,  tele¬ 
communications  used  to  transmit  data  to  headquarters,  com¬ 
puter  time  used  to  process  data,  and  management  time  used  to 
supervise  the  data  collection  effort  and  correct  errors. 

Yet  the  useful  value  of  much  of  the  MDC  data  currently  col- 
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lected  and  processed  through  management  information  systems 
is  considered  marginal  by  managers  (22:16-20).  A  recent 
study  of  Air  Force  maintenance  information  systems  conducted 
by  the  General  Accounting  Office  (GAO)  questioned  the  need 
to  collect  such  a  large  volume  of  data  if  it  i3  not  of  value 
to  management  (22:23). 

A  better  method  of  providing  field  reliability  and 
maintainability  data  collection  and  feedback  is  needed 
(29:IV-24).  The  collection  of  improved  R&M  data  can  be  ac¬ 
complished  either  by  increasing  the  number  of  data  elements 
collected,  over  and  above  that  of  the  current  MDC  system, 
with  increased  cost  and  effort;  or  by  reducing  the  volume  of 
MDC  data  and  using  the  effort  and  cost  savings  to  collect 
additional  data.  It  would  be  useful  to  determine  if  a  rrath- 
od  can  be  found  of  reducing  the  volume  of  MDC  data  collec¬ 
tion  while  maintaining  the  level  of  information  derived  from 
the  data. 

Statistical  sampling  techniques  have  been  used  for 
decades  to  collect  data  on  a  smaller  segment  of  a  population 
and  to  infer  from  the  sample  some  useful  information  about 
the  total  population.  It  might  be  possible  to  use  statis¬ 
tical  sampling  techniques  to  collect  aircraft  maintenance 
failure  and  manhour  data,  from  which  inferences  can  be  made 
about  the  behavior  of  an  entire  aircraft  fleet.  Sampling 
techniques  may  reduce  the  volume  of  current  MDC  data  col¬ 
lected.  This  could  permit  the  increased  collection  of  bet- 
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tec  quality  reliability  and  maintainability  data  without 
adding  additional  costs  or  increasing  the  data  collection 
effort  required  by  maintenance  personnel.  This  study  is 
concerned  with  evaluating  the  feasibility  of  using  statis¬ 
tical  sampling  for  this  purpose. 

Research  Objectives 

The  overall  objective  of  this  research  is  to  determine 
whether  statistical  sampling  is  a  practical  and  feasible 
method  of  reducing  the  volume  and  cost  of  HOC  data  without 
losing  any  valuable  information.  If  sampling  methods  can  be 
used  to  collect  failure  and  manhour  data  with  an  acceptable 
level  of  precision  and  a  practical  sample  size,  it  should  be 
possible  to  reduce  the  volume  of  data  collected  and  process¬ 
ed.  This  would  reduce  the  cost  of  data  collection  and  pro¬ 
cessing;  reduce  the  amount  of  unproductive  time  required  to 
record,  process,  and  analyze  the  data;  and  improve  the  qual¬ 
ity,  accuracy,  and  detail  of  the  information  collected.  The 
cost  and  effort  saved  can  then  be  used  for  other  purposes. 

MDC  data  are  collected  on  both  scheduled  and  unsched¬ 
uled  maintenance  activities.  Unscheduled  maintenance  MDC 
records  account  for  nearly  two  thirds  of  all  MDC  data. 

Thus,  a  reduction  in  the  volume  of  unscheduled  maintenance 
documentation  through  the  use  of  statistical  sampling  repre¬ 
sents  the  greatest  potential  for  savings.  Therefore,  this 
study  will  only  be  concerned  with  unscheduled  maintenance 
data.  The  feasibility  of  applying  sampling  concepts  to  the 
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collection  of  unscheduled  maintenance  data  will  be  evalu- 
ated  against  two  m.»in  criteria: 

a.  Can  the  sampling  scheme  be  practically  controlled 
and  administered  in  the  field  without  any  major  changes  in 
the  way  the  data  is  currently  collected  and  subsequently 
used  in  management  information  systems? 

b.  Can  the  use  cf  sampling  significantly  reduce  the 
costs  associated  with  the  collection  and  processing  of  MDC 
data? 

Pour  subordinate  objectives  support  the  overall  thesis 
objective: 

a.  Develop  a  practical,  reliable,  and  representative 
sampling  scheme  that  can  be  easily  implemented  in  the  field. 

b.  illustrate  the  precision  that  can  be  obtained  using 
the  sampling  scheme  on  selected  MDC  data  and  determine  if 
the  sample  size  required  to  attain  this  precision  is  prac¬ 
tical  for  routine  data  collection. 

c.  Address  the  cost  of  data  collection  compared  to  the 
difference  in  information  obtained  by  census  and  sampling. 

d.  Evaluate  the  impact  of  sampling  on  the  data  that 
would  be  used  by  LCOM,  VAMOSC,  and  the  Product  Performance 
System. 

Research  Questions 

The  following  questions  were  developed  to  guide  the 
ce search  effort: 
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1.  What  sampling  plan(s)  can  best  be  applied  to  the 
collection  of  aircraft  failure  and  maintenance  manhour  data 
to  provide  the  same  type  of  information  to  users  of  the  MDC 
data? 

2.  What  degree  of  precision  can  be  obtained  by  sam¬ 
pling  and  how  large  must  the  sample  size  be? 

3.  Bow  can  the  sample  data  be  U3ed  and  related  to  the 
entire  population  to  obtain  information  such  as  Maintenance 
Manhours  per  Plying  Hour  (MM/FH)  and  Mean  Time  Bt=‘,ween  Main¬ 
tenance  (MTBM) ? 

4.  Will  sampling  provide  significant  cost  savings  over 
the  current  census  data  collection  methods? 

5.  What  is  the  impact  of  the  use  of  sample  data  on 
LCOM,  vamosc,  and  the  Product  Performance  System? 

6.  How  can  sampling  be  practically  administered  and 
controlled  in  he  field? 


II.  Literature  Review 
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Introduction 

The  Air  Force  Maintenance  Data  Collection  System  (MDC ) 
has  been  in  use  for  almost  30  years.  During  that  period, 
many  other  information  systems  have  been  developed  which  use 
data  supplied  by  the  MDC  system  to  varying  degrees.  MDC 
data  are  used  by  over  a  dozen  logistics  management  informa¬ 
tion  systems  and  are  supplied  to  over  30  defense  contractors 
and  other  Air  Force  agencies.  Considering  the  extensive  use 
of  MDC  data,  any  change  in  the  data  collection  process  can 
have  a  major  impact  on  many  users  of  MDC  data.  Since  this 
research  on  the  use  of  sampling  to  collect  MDC  data  repre¬ 
sents  such  a  change,  it  is  necessary  to  examine  the  impacts 
of  a  sampling  concept  on  the  users  of  MDC  data. 

Tnis  literature  review  provides  an  understanding  of  the 
MDC  system  and  the  uses  of  MDC  data  at  all  levels.  It 
focuses  on  the  past  and  present  attempts  to  use  sampling 
concepts  to  collect  maintenance  data. 

Maintenance  Data  Collection  System 

Historical  Perspective .  The  Air  Force  began  the  col¬ 
lection  of  data  on  base  level  maintenance  activities  through 
the  MDC  system  in  1958.  Prior  to  that  time,  maintenance  ac¬ 
tivities  were  documented  manually,  in  an  unstructured  narra¬ 
tive  description,  on  Unsatisfactory  Reports  (URs) .  Clark 
and  Badalmente  describe  the  evolution  of  the  MDC  system. 
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They  state  that  because  the  URs  were  unstructured  and  non- 
standardized ,  it  was  difficult  to  perform  a  meaningful  anal¬ 
ysis  of  unfavorable  maintenance  problems.  This  was  com¬ 
pounded  by  a  belief  that  only  eight  to  ten  percent  of  the 
equipment  failures  associated  with  potential  problems  were 
being  reported  (8:6-7).  Badalmente  and  Clark  reported  that 
there  was  concern  that  decisions  might  be  made  incorrectly 
on  such  a  small  sample  of  data,  and  that  there  was  equal 
concern  that  the  means  to  assess  equipment  reliability 
across  the  inventory  did  not  exist.  In  addition.  Air  Force 
management  wanted  a  systematic  method  of  establishing, 
adjusting,  and  justifying  manpower  requirements  to  Congress. 
To  satisfy  these  requirements,  the  MDC  system  was  ultimately 
established  with  a  100  percent  reporting  requirement.  The 
mandatory  reporting  was  designed  to  replace  the  URs  with  a 
set  of  coded  data  for  analysis  of  unsatisfactory  equipment 
performance  (8:6-7). 

The  continued  improvements  in  computer  technology  pro¬ 
vided  another  step  in  the  MDC  evolutionary  process.  In 
1966,  the  development  of  the  Maintenance  Management  Informa¬ 
tion  and  Control  System  (MMICS)  was  begun  with  the  purpose 
of  providing  an  automated  system  for  maintenance  management. 
Development  of  the  system  continued  in  stages  throughout  the 
late  1960s  and  early  1970s.  It  was  tested  and  approved  for 
initial  implementation  in  1973.  The  AFTO  Form  349,  still  in 
use  today,  was  developed  in  1968  to  provide  a  data  collec- 
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tion  and  control  instrument  more  amenable  to  the  evolving 
MMICS  system  than  those  previously  used  (8:9).  The  state- 
of-the-art  computers  in  use  during  the  MMICS  development  re¬ 
lied  strictly  on  punch  cards  and  magnetic  tape  for  data  pro¬ 
cessing.  Accordingly,  the  procedures  for  collecting  and 
processing  MDC  data  were  designed  to  accommodate  the  tech¬ 
nology  availai^e  at  the  time.  The  MDC  and  MMICS  systems  in 
use  today  have  remained  virtually  the  same  since  their  orig¬ 
inal  development. 

Over  the  past  several  decades,  management  has  question¬ 
ed  the  MDC  system  reporting  concepts,  specifically  the  need 
to  collect  census  data.  In  1969,  the  Air  Force  Logistics 
Command  (AFLC)  and  the  Strategic  Air  Command  (SAC)  conducted 
a  test  of  a  limited  reporting  concept,  to  determine  if  cen¬ 
sus  data  was  really  necessary.  The  limited  reporting  con¬ 
cept  resulted  it.  a  loss  of  some  failure  data  considered 
essential  by  AFLC.  The  limited  reporting  concept  was  dis¬ 
continued,  and  census  data  collection  was  retained  (8:8-9). 
In  1973,  an  Air  Staff  and  Major  Command  team  studied  the 
uses  of  maintenance  data  during  Project  Rivet  Rally  to  de¬ 
termine  the  information  needs  of  MDC  users.  The  study  con¬ 
cluded  that  the  users  needed  more  information  than  they  cur¬ 
rently  received.  However,  this  study  produced  no  changes  in 
the  maintenance  data  reporting  concepts  (8:9).  In  1976,  a 
contractor  study,  entitled  "Project  REALMS:  Recommendations 
to  Enhance  the  Air  Logistics  System,"  was  conducted  to  de- 


termine  whether  sampling  techniques  could  be  used  to  collect 
manhour  and  equipment  reliability  data  (1:1).  The  study  re¬ 
port  recommended  the  use  of  statistical  sampling  methods  and 
trained  observers  to  gather  manhour  data  (22:21).  In  1977, 
the  Air  Force  issued  a  Program  Management  Directive  (PMD) 
tasking  the  Air  Force  Logistics  Management  Center  (AFLMC)  to 
design  and  conduct  a  pilot  test  of  a  modified  MDC  system  as 
outlined  in  the  study  report.  The  objectives  of  the  pilot 
test  were  to  answer  questions  raised  about  the  technical  as¬ 
pects  and  cost  effectiveness  of  sampling  and  to  assess  the 
impact  of  the  contractor’s  recommendations  (22:21-22).  The 
conclusion  reached  as  a  result  of  the  pilot  study  was  that 
sampling  methods  were  technically  feasible;  however,  they 
were  neither  practical  nor  cost-effective  to  administer 
(5:4.2).  No  changes  to  the  MDC  system  or  reporting  concepts 
were  made  as  a  result  of  the  Project  REALMS  and  MDC  Modifi¬ 
cation  Project  studies.  Also  in  1977,  an  Air  Staff  evalua¬ 
tion  team  studied  the  paperwork  impact  of  various  proposed 
methods  of  reducing  MDC  data  collection.  This  study  con¬ 
sidered  the  elimination  of  off-shore  reporting  and  support 
general  documentation  in  the  MDC  system.  The  study  led  to  a 
1978  joint  recommendation  by  the  Deputy  Assistant  Secretary 
of  the  Air  Force  for  Logistics  and  the  Deputy  for  Productiv¬ 
ity  Management  that  engineered  labor  time  standards  be  used 
as  a  way  to  reduce  documentation  and  increase  productivity. 

In  response,  HQ  USAF/MPM  and  LEY  agreed  to  pursue  the  devel- 


14 


opment  of  job  standards  for  highly  repetitive  or  manhour  in¬ 
tensive  tasks  in  the  support  general  area,  in  lieu  of  the 
detailed  reporting  of  every  task  by  individual  technicians 
(22:22).  The  use  of  job  standards  for  support  general  tasks 
proved  to  be  successful  in  reducing  MDC  documentation;  as  a 
result,  job  standards  for  support  general  tasks  are  routine¬ 
ly  used  today  (12:7.1). 

Since  the  late  1970s,  the  Air  Force  has  been  attempting 
to  update  its  computer  resources  to  take  advantage  of  cur¬ 
rent  technology  that  was  not  yet  available  when  the  MMICS 
system  was  developed.  In  1975,  the  Air  Force  began  a  test 
of  an  Automated  Maintenance  System  (AMS)  with  the  C-5A  at 
Dover  AF3,  DE.  The  AM~  is  designed  around  the  Malfunction 
Analysis  Detection  and  Recording  System  (MADARS)  onboard 
the  C-5  and  it's  associated  Ground  Processing  System  (GPS). 
The  AMS  provides  the  maintenance  manager  with  on-line,  real 
time  data  input  and  retrieval  capability.  These  features 
are  designed  to  eliminate  inaccurate  data  input,  improve 
management  access  to  useful  and  current  information,  reduce 
paperwork,  and  improve  maintenance  efficiency  and  effective¬ 
ness  (22:24-30).  The  AMS  test  demonstrated  the  benefits  of 
state-of-the-art  computer  technology  to  the  maintenance  man¬ 
agement  arena.  Since  1975,  there  have  been  attempts  to 
implement  the  AMS  system  concept  Air  Force  wide.  However, 
funding  restrictions  delayed  this  initiative  until  the  Air 
Force  began  implementation  of  the  Phase  IV  computer  upgrade 
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program  in  the  mid  1980s.  An  AMS  derivative,  the  Core  Auto¬ 
mated  Maintenance  System  (CAMS) ,  was  developed  in  conjunc¬ 
tion  with  the  Phase  IV  program  and  is  currently  being  tested 
at  three  bases.  If  the  tests  are  successful,  the  CAMS  will 
be  implemented  throughout  the  Air  force  beginning  in  April 
1986  (21:16).  The  CAMS  system  is  designed  around  the  origi¬ 
nal  MMICS  and  the  AMS  system  concepts.  As  developed,  it 
does  not  change  the  maintenance  reporting  concepts  that  have 
been  used  since  the  MDC  system  was  originally  designed. 

Purposes  and  Uses  of  MDC  Data 

The  Maintenance  Data  Collection  System  was  developed  to 
provide  management  with  the  means  to  assess  equipment  relia¬ 
bility  and  the  effectiveness  of  the  Air  Force  maintenance 
effort.  These  two  broad  categories  can  be  directly  related 
to  a  significant  portion  of  the  Air  Force  budget  and  to  the 
readiness  and  sustainability  of  our  combat  forces.  Effec¬ 
tiveness  is  measured  through  the  MDC  system  in  the  form  of 
personnel  productivity  and  operating  and  support  costs.  Re¬ 
liability  is  measured  as  a  function  of  the  number  of  fail¬ 
ures  reported  through  the  MDC  system  and  the  flying  or  oper¬ 
ating  hours  of  aircraft  or  equipment.  Maintainability  can 
be  measured  as  a  function  of  the  manhours  required  to  make 
repairs.  The  MDC  data  are  used  as  a  measure  of  the  relia¬ 
bility  and  maintainability  of  current  weapon  systems.  Reli¬ 
ability  and  maintainability  are  key  factors  that  influence 
weapon  system  design,  effectiveness,  logistic  support  re- 
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quirements,  and  life  cycle  costs.  Collection  of  maintenance 
data  is  intended  to  provide  a  critical  information  feedback 
loop  to  management  at  all  levels,  in  both  the  acquisition 
and  logistics  communities. 

MDC  data  are  intended  for  use  by  management  at  both  the 
base  level  and  by  other  commands  and  agencies.  At  base  lev¬ 
el,  the  intended  use  of  the  data  is  to  provide  information 
feedback  to  base  managers  and  supervisors  for  controlling 
the  maintenance  operation.  Other  commands  and  agencies  use 
the  data  as  feedback  to  managers  on  the  performance  and  sup¬ 
port  requirements  of  Air  Force  weapon  systems  and  equipment 
(12:1.3) . 

Base  Level  Uses  of  MDC  Data.  MDC  data  are  intended  to 
provide  base  level  managers  and  supervisors,  directly  or 
indirectly,  with  the  following  types  of  information  to 
effectively  manage  their  operations  (12:1.3): 

1.  Production  information  about  the  type  of  work  per 
formed,  units  performing  the  work,  and  equipment  on 
which  the  work  is  performed. 

2.  Equipment  maintenance  schedules. 

3.  Direct  and  indirect  labor  expenditures. 

4.  Equipment  failure  and  discrepancy  information. 

5.  Status  of  equipment  modifications. 

6.  Cost  of  civilian  and  military  labor. 

7.  Cost  of  productive  direct  and  indirect  labor  hours. 

8.  Cost  to  maintain  aircraft,  engines,  and  equipment. 

9.  Reimbursement  for  maintenance  on  transient  air- 
craft. 
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AFLC  Uses  of  MDC  Data.  The  Air  Force  Logistics  Command 
uses  the  MDC  data  internally  in  its  logistics  management 
functions  to  (12:1.4): 

1.  Identify  reliability  and  maintainability  problems 
on  Air  Force  equipment. 

2.  Establish  priorities  for  product  improvements  and 
modifications. 

3.  Keep  track  of  modifications  and  evaluate  their 
effectiveness. 

4.  Validate  inspections  and  time  change  requirements 
and  intervals. 

5.  Identify  safety  deficiencies  and  monitor  corrective 
action. 

6.  Validate  and  adjust  calibration  intervals. 

7.  Validate  spares  requirements. 

8.  Identify  programmed  depot  maintenance  requirements. 

9.  Compile  fleet  estimates  of  maintenance  manhours  per 
flying  hour  (MH/FH) . 

10.  Evaluate  unsatisfactory  material  reports  and  modi¬ 
fication  proposals  from  other  commands  and 
industry. 

11.  Recover  costs  of  depot  maintenance  performed  for 
other  commands  and  agencies. 

Other  Uses  of  MDC  Data.  In  addition  to  it's  own  inter¬ 
nal  uses  of  MDC  data,  AFLC  provides  MDC  data  to  industry  and 
the  Air  Force  Systems  Command.  The  data  are  used  to  relate 
the  performance  and  support  requirements  of  current  invento¬ 
ry  equipment  to  the  development  of  new  weapon  systems.  Data 
are  also  provided  to  Headquarters  USAF,  other  services,  and 
the  major  commands  (MAJCOMS) .  MDC  data  are  used  by  the 
MAJCOMS  to  determine  the  status  of  equipment  modifications; 
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b  HQ/USAF  and  the  MAJCOMS  for  determining  and  validating 
manpower  requirements;  and  by  HQ/USAF  Accounting  and  Finance 
to  determine  the  cost  of  base  level  maintenance  operations 
(12:1.5)  . 

MDC  System  Description 

The  Maintenance  Data  Collection  System  can  best  be 
understood  by  examining  the  types  of  maintenance  data  col¬ 
lected,  the  data  collection  process,  and  the  data  process¬ 
ing  procedures.  The  following  sections  are  mainly  provided 
for  those  readers  who  are  unfamiliar  with  the  MDC  system. 

Coded  Maintenance  Data.  All  maintenance  data  are  re¬ 
ported  through  the  use  of  alpha-numeric  codes  designed  to 
simplify  and  standardize  the  recording  procedures;  to  pro¬ 
vide  the  required  information  with  a  minimum  amount  of  writ¬ 
ing  on  the  recording  form;  and  to  minimize  the  computer  pro¬ 
cessing  and  storage  requirements  (12:3.1).  The  types  of 
codes  used  and  their  functions  are  (12:4.1-4.10): 

1.  Job  Control  Number  (JCN) :  The  JCN  is  a  unique  sev¬ 
en  character  number  used  to  control  and  identify  authorized 
maintenance  jobs.  This  number  provides  a  means  of  tying  to¬ 
gether  all  maintenance  actions  taken,  labor  hours  expended, 
and  parts  replaced  in  satisfying  a  specific  maintenance  dis¬ 
crepancy. 

2.  Work  Center  Code.  The  workcenter  code  consists  of 
five  characters  and  is  used  to  identify  the  organization  to 
which  maintenance  personnel  are  assigned  or  dispatched. 
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3.  Identification  Number  (ID) .  The  ID  number  consists 


of  six  characters  and  is  used  to  identify  aircraft  or  equip¬ 
ment  upon  which  work  is  performed  or  from  which  the  item  was 
removed. 

4.  Type  Maintenance  Code.  The  type  maintenance  code 
consists  of  one  character,  which  is  used  to  identify  the 
type  of  maintenance  work  being  accomplished.  Examples  of 
type  maintenance  are  preflight,  inspection,  or  unscheduled 
maintenance. 

5.  Work  Unit  Code  (WUC) .  The  WOC  is  a  five  character 
code  used  to  identify  the  systems,  subsystems,  or  components 
upon  which  maintenance  is  required  or  performed.  Work  unit 
codes  are  designed  as  quick  reference  numbers  to  identify 
system,  subsystem  and  component  relationships.  This  pro¬ 
vides  a  standard  method  of  sorting  maintenance  data  and  of 
summarizing  different  levels  of  detail.  Work  unit  codes 
provide  the  capability  to  utilize  data  in  maintenance  or 
engineering  programs  by  multiple  systems,  individual  sys¬ 
tems,  subsystems,  or  components  within  each  weapon  or  sup¬ 
port  system. 

6.  Action  Taken  Code.  The  action  taken  code  consists 
of  one  character  used  to  identify  the  actions  taken  by  the 
technician  in  the  process  of  performing  maintenance.  Common 
examples  of  actions  taken  are  troubleshooting,  remove  and 
replace,  and  bench  check. 


20 


7.  When  Discovered  Code.  This  one  character  code  is 


used  to  identify  when  a  defect  requiring  maintenance  was 
discovered  in  terms  of  equipment  operation  or  maintenance 
activity.  For  example,  the  defect  might  have  been  noted 
during  flight,  preflight,  or  major  inspection.  Discrepan¬ 
cies  which  cause  a  mission  abort  have  distinct  codes  to 
identify  the  operational  impact  of  the  fault. 

8.  Category  of  Labor .  This  data  element  is  used  to 
distinguisn  between  types  of  manhour  expenditures,  such  as 
military  or  civilian,  regular  or  overtime,  and  direct  or 
indirect  labor. 

9.  Employee  Number .  This  number  is  a  five  digit  code 
used  to  identify  the  individual  technician  who  performed  the 
maintenance  action. 

Logic  of  Data  Elements.  The  coded  data  supplied  by  the 
maintenance  technician  can  be  converted  into  meaningful  in¬ 
formation  for  analysis  purposes.  The  data  are  intended  to 
provide  a  complete  record  of  all  activities  required  as  a 
result  of  a  particular  discrepancy.  For  a  given  discrepan¬ 
cy,  it  is  possible  to  determine  which  aircraft  was  involved; 
which  system  components  and  parts  malfunctioned;  what  the 
malfunction  was;  when  it  was  discovered;  what  actions  were 
required  to  make  repairs;  who  was  involved  in  the  repair; 
which  shop  the  technician  was  assigned  to;  and  how  many 
manhours  were  required  to  make  the  repair.  It  is  also 
possible  to  recreate  a  complete  maintenance  history  for  a 
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particular  airframe  for  a  particular  time  period,  or  to 
determine  the  number  of  failures  of  a  specific  type  of  com¬ 
ponent  on  a  particular  aircraft.  The  MDC  system  has  the  po¬ 
tential  to  provide  a  great  deal  of  useful  information  for 
detailed  analysis  at  the  micro  level. 

The  MDC  system  is  also  designed  to  provide  data  at  the 
macro  level.  At  this  level  there  is  less  interest  in  spe¬ 
cific  information  about  a  particular  airframe,  and  more  in¬ 
terest  in  base  and  fleet  level  summary  information.  For 
example,  the  MDC  data  can  provide  the  total  number  of  fail¬ 
ures  for  a  specific  type  of  component  and  the  total  manhours 
required  to  maintain  or  repair  the  component.  This  informa¬ 
tion  is  used  in  the  determination  of  support  costs  and 
spares  requirements,  and  to  validate  manpower  requirements. 

Data  Collection.  There  are  currently  two  methods  of 
data  collection  used  in  the  Air  Force.  Manual  data  collec¬ 
tion  on  paper  forms,  with  data  entry  by  punch  cards,  is 
still  the  most  widely  u3ed  method  as  of  this  writing.  One 
base,  testing  an  automated  maintenance  system  concept,  col¬ 
lects  data  manually,  with  real  time  data  entry  into  a  com¬ 
puter  terminal.  The  trend  in  the  future,  with  the  Core 
Automated  Maintenance  System,  will  be  the  simultaneous  data 
collection  and  entry  by  the  maintenance  technician  through  a 
computer  terminal. 

Data  Processing  and  Transmission.  Maintenance  data  are 
processed  at  the  base  level  and  stored  on  magnetic  tape. 
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The  data  are  transmitted  monthly  to  the  Air  Force  Logistics 
Command  Headquarters  either  through  electronic  communication 
links  or  by  physically  sending  a  copy  of  the  tape  through 
the  mail.  The  data  from  all  bases  are  then  processed  by  the 
D056  Product  Performance  System.  AFLC  provides  the  monthly 
data  to  the  MAJCOMS,  air  logistics  centers,  and  other  users. 
The  data  are  also  supplied  at  various  times  to  a  number  of 
other  AFLC  information  systems,  such  as  the  Visibility  and 
Management  of  Operating  and  Support  Costs  (VAMOSC  II)  system 
(24). 

In  addition  to  the  transmission  of  data  to  AFLC,  base 
level  data  tapes  are  used  by  MAJCOM  management  and  manpower 
engineering  teams  in  their  determination  of  manpower  re¬ 
quirements  using  the  LCOM  model.  These  tapes  are  not  trans¬ 
mitted  on  a  regular  basis  because  manpower  requirements  for 
a  specific  base  are  not  continuously  evaluated.  When  the 
manpower  requirements  determination  is  performed  for  a  par¬ 
ticular  base,  tapes  containing  maintenance  data  for  the  past 
year  are  sent  from  the  base  to  the  command  or  agency  per¬ 
forming  the  manpower  analysis  (7:3.4). 

Use  of  MDC  Data  in  Other  Information  Systems 

Although  the  data  provided  by  the  MDC  system  are  used 
by  numerous  management  information  systems  and  many  other 
individual  users,  the  Product  Performance  System  (D056) ,  the 
Visibility  and  Management  of  Operating  and  Support  Costs 
(VAMOSC)  system,  and  the  Logistics  Composite  Modeling  (LCOM) 
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system  represent  the  largest  Air  Force  users.  Since  it  is 
not  the  objective  of  this  research  effort  to  examine  the 
impacts  of  sampling  on  every  user  of  MDC  data,  the  discus¬ 
sion  which  follows  will  be  limited  to  these  three  systems. 

Product  Performance  System.  The  major  recipient  of  the 
NDC  data  is  the  Product  Performance  System  (0056) ,  operated 
by  the  Air  Force  Logistics  Command.  This  system  receives 
and  processes  maintenance  data  from  every  unit  operating  un¬ 
der  MDC  documentation  procedures,  and  it  serves  as  a  central 
distribution  point  for  MDC  data.  As  such,  it  becomes  a  key 
interface  between  the  MDC  system  and  most  MDC  data  users. 

The  D056  system  processes  data  which  enables  AFLC  to  perform 
a  major  portion  of  its  logistics  management  functions.  It 
consists  of  five  separate  subsystems  described  below  (3): 

D056A  Edit  and  Error  Analysis.  This  system  serves 
as  a  central  data  distribution  point  for  other  system  inter¬ 
faces  with  the  MDC  system.  The  basic  function  of  the  D056A 
system  is  to  receive  data,  check  it  for  format  and  compati¬ 
bility,  and  either  correct  or  remove  records  not  passing  the 
checks.  This  is  accomplished  by  comparing  the  data  with  a 
master  edit  file  containing  all  allowable  data  entries.  The 
D056A  system  also  distributes  data  to  the  other  four  D056 
subsystems,  other  AFLC  management  information  systems,  and 
other  users.  The  D056A  system  does  not  prevent  inaccurate 
data  from  being  passed  on  to  other  systems.  As  long  as  the 
data  format  is  correct,  the  codes  used  are  compatible,  and 
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the  data  elements  exist  in  the  master  edit  file,  the  HOC 
data  records  are  accepted  (2<i). 

PQ56B  On  Equ ipment  Analysis.  The  D056B  system 
receives  all  data  concerning  on-equipment  maintenance.  The 
basic  function  of  the  D0568  system  is  to  provide  structured 
eports  for  analysis  of  reliability  trends,  work  unit  code 
usage,  inspection  frequencies,  corrosion  problems,  and  can¬ 
nibalization  of  parts.  In  general,  these  reports  provide 
summary  information  of  various  maintenance  activities  at  the 
aircraft  or  equipment  system  level  by  base,  command,  and 
weapon  system.  The  0056B  system  is  primarily  designed  to 
support  the  AFLC  system  managers  (24) . 

DO 56C  Off  Equipment  Analysis.  The  D056C  system 
receives  all  data  concerning  off  equipment  maintenance  and 
provides  structured  reports  concerning  repair  of  components, 
repair  capabilities,  repair  rates,  and  parts  consumption. 

In  general,  these  reports  provide  summary  information  of 
maintenance  activities  at  the  component  and  parts  level,  by 
base,  command,  and  component.  The  D056C  system  is  primarily 
designed  to  support  the  AFLC  item  managers  (24) . 

D056E  Data  to  Contractors.  This  system  receives 
selected  on  and  off  equipment  maintenance  data  from  the 
D056A  system  and  operational  data  from  the  G032B  Aircraft 
Status  Inventory  and  Utilization  System.  Data  are  then  dis¬ 
tributed  to  over  30  defense  contractors  and  the  Air  Force 
Systems  Command.  The  primary  function  of  the  D056E  system 
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is  to  provide  feedback  of  information  to  the  defense  con¬ 
tractors  where  it  is  used  to  evaluate  the  field  performance 
of  current  equipment.  This  information  is  also  used  to 
evaluate  the  need  for  design  changes  to  improve  current  or 
future  weapon  system  designs  (24). 

D056T  Reliability,  Availability,  and  Maintainabil¬ 
ity.  The  D056T  system  combines  MDC  data  from  the  D056B  On 
Equipment  Analysis  system  and  operations  data  from  the  G033B 
Aircraft  inventory  status  and  Reporting  System,  to  provide 
summary  reports  of  mean  time  between  maintenance  actions 
(MTBM) ,  maintenance  manhours  per  flying  hour  (MM/FH) ,  and 
weapon  system  availability  at  the  base  and  fleet  levels. 

This  information  is  used  to  assess  the  relative  performance 
of  weapon  systems  in  terms  of  reliability,  maintainability, 
and  availability  (24). 

Visibility  and  Management  of  Operating  and  Support 
Costs  (VAMOSC  II) .  One  of  the  major  information  systems 
using  MDC  data  supplied  by  the  Product  Performance  System  is 
VAMOSC.  VAMOSC  is  a  management  information  system  that 
gathers,  tracks,  and  computes  operating  and  support  costs  by 
weapon  system  (13:3).  VAMOSC  is  essentially  a  cost  collec¬ 
tion  system,  rather  than  a  cost  accounting  or  cost  estimat¬ 
ing  system.  It  is  not  a  cost  accounting  system  because  no 
attempt  is  made  to  reconcile  budget  appropriations  with 
actual  expenditures.  It  is  not  an  estimating  system  because 
it  uses  census  data;  thus,  actual  rather  than  estimated 
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costs  are  collected  (30:11).  The  information  generated  by 
the  VAMOSC  system  is  used  as  a  basis  for  analyses  of  the 
following:  force  program  balance;  weapon  systems  compari¬ 
sons;  support  resource  planning;  reliability  and  maintaina¬ 
bility  trade  studies;  logistics  support  alternatives;  af¬ 
fordability  studies;  warranty/contractor  support  monitoring; 
and  equipment  maintenance  management  (30:6-7). 

The  VAMOSC  system  consists  of  three  separate  subsys¬ 
tems:  the  weapon  System  Support  Cost  system  (WSSC) ,  the  Cora- 
munications-Electronics  (C-E)  cost  system,  and  the  Component 
Support  Cost  System  (CSCS) .  Since  this  research  will  be 
primarily  concerned  with  aircraft  maintenance  data  report¬ 
ing,  only  the  WSSC  and  the  CSCS  systems  will  be  discussed. 

WSSC  System.  The  WSSC  system  provides  the  user 
with  operating  and  support  cost  information  at  the  weapon 
system,  or  Mission-Design-Series  (MDS)  level,  by  base  or  at 
the  fleet  level.  All  costs  associated  with  a  weapon  system 
are  collected  at  a  summary,  or  aggregate,  level  of  detail. 
Costs  that  are  directly  accountable  to  a  weapon  system,  such 
as  fuel  consumption,  are  charged  directly  to  the  system. 
Costs  that  are  not  directly  accountable,  such  as  installa¬ 
tion  security,  are  charged  against  the  weapon  system  through 
various  allocation  formulas  (13).  The  WSSC  system  uses 
direct  maintenance  manhour  data  provided  by  the  MDC  system, 
through  D056,  as  the  basis  for  allocation  of  below  depot 
maintenance  costs  by  MDS  (4:7).  Manhour  data  are  the  only 
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inputs  supplied  by  the  MDC  system  that  are  used  by  the  WSSC 
system.  All  other  cost  data  are  supplied  by  other  informa¬ 
tion  systems. 

CSCS  System.  The  CSCS  System  provides  operating 
and  support  cost  information  on  the  components  of  aircraft 
and  equipment  at  the  two  and  five  digit  work  unit  code  (WUC) 
level,  and/or  the  National  Stock  Number  (NSN)  level,  by  base 
and  MDS  (30:9).  The  CSCS  system  establishes  a  data  base  for 
use  in  portraying  depot  and  base  costs  associated  with  an 
MDS.  The  aggregated  data  base  is  accumulated  and  retained 
at  the  MDS  level  for  ten  years  and  at  the  base  level  for 
five  years  (14:5). 

The  CSCS  systems  receives  direct  labor  hour  and  actions 
taken  data  from  the  D056  Product  Performance  System.  The 
system  suras  all  mannours  reported  through  the  MDC  system  by 
like  WUC,  MDS  and  base.  Manhours  are  multiplied  by  the  base 
labor  costs  and  summed  to  determine  the  total  labor  costs  of 
base  maintenance.  Total  number  of  repair  actions  taken  at 
the  two  and  five  digit  work  unit  code  levels  are  used  as  the 
basis  to  allocate  material  costs,  supplied  by  the  D002  Stan¬ 
dard  Base  Supply  System,  to  particular  components  by  air¬ 
craft  MDS  (14:65-66) . 

Logistics  Composite  Modeling  (LCOM)  System.  The  LCOM 
system  is  the  third  major  user  of  MDC  data.  Unlike  most 
other  users,  MDC  data  needed  to  develop  an  LCOM  simulation 
database  are  provided,  on  request,  directly  from  the  base  at 
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which  the  data  are  collected,  rather  than  through  the  D056 
system.  Both  failure  and  manhour  data  are  used  in  conjunc¬ 
tion  with  the  LOOM  system,  although  the  failure  data  are 
used  to  a  much  greater  extent. 

System  Description.  Air  Force  Regulation  25-5 
provides  a  thorough  general  description  of  the  LCOH  system 
and  it's  uses: 

The  LCOM  system  is  a  large  scale  computer  simula¬ 
tion  used  to  model  manpower  and  other  logistics 
requirements.  It  considers  a  random  employment 
of  different  support  resources  and  provides  infor¬ 
mation  to  aid  the  user  in  deciding  the  best  mix  of 
resource  levels  to  support  a  given  requirement. 

LCOM  capabilities  range  from  simulating  very  small 
to  very  large  weapon  systems  and  other  functions 
that  lend  themselves  to  simulation  modeling.  LCOM 
manpower  studies  may  be  developed  for  one  or  more 
locations  or  weapon  systems.  Because  LCOM  studies 
identify  [both]  peacetime  and  wartime  requirements 
they  provide  a  more  defensible  budget  position  and 
allow  for  effective  utilization  of  available 
resources  (10:1). 

Use  of  MDC  Failure  Data.  The  failure  data  sup¬ 
plied  by  the  MDC  system  are  used  to  design  networks  in  the 
LCOM  simulation  models.  The  networks  describe  mathematical¬ 
ly  the  many  complex  maintenance  activities  for  use  in  a  com¬ 
puter  simulation  program.  The  failure  data  are  used  to  de¬ 
termine  both  the  frequencies  with  which  failures  occur  and 
the  frequency  of  the  maintenance  actions  required  to  make 
repairs.  These  data  are  used  to  simulate  random  failures 
and  the  actions  that  would  have  to  be  taken  to  make  repairs. 
In  general,  MDC  data  are  used  to  model  unscneduled  mainten¬ 
ance  requirements  (7) . 
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Use  of  MDC  Manhour  Data.  To  completely  model  the 
maintenance  activities,  the  time  required  to  perform  a  given 
task  on  a  specific  piece  of  equipment  must  be  accurately  de¬ 
termined.  This  type  of  information  is  collected  by  the  MDC 
system;  however,  it  is  not  sufficiently  accurate  for  use  in 
the  LCOM  model.  In  addition,  since  the  LCOM  model  is  used 
to  determine  manpower  requirements  for  the  organizations 
collecting  the  data,  there  could  be  a  tendency  to  inflate 
the  manhour  data  to  justify  a  larger  manpower  requirement. 

As  a  result,  maintenance  task  times  are  developed  through 
other  measurement  techniques  (8) .  The  most  widely  used 
techniques  are  work  measurement  studies  and  operational 
audits.  Work  measurement  studies  involve  the  use  of  statis¬ 
tical  sampling  and  are  generally  used  to  measure  the  time 
required  for  those  tasks  which  occur  frequently  or  that  are 
easily  observed.  Operational  audit  techniques  are  used  for 
those  tasks  which  occur  infrequently  or  are  not  easily 
observed.  Operational  audits  consist  of  interviews  with 
reliable  and  knowledgeable  field  personnel  to  ascertain  the 
time  required  to  complete  specific  tasks  (7:C.1-C.9).  MDC 
manhour  data  are  used  to  validate  LCOM  simulation  results. 
For  example,  maintenance  manhour  per  flying  hour  data  can  be 
used  to  establish  a  baseline  for  validating  the  simulation 
results  (7:5.53).  The  simulation  results  can  be  compared 
with  the  MH/FH  data  to  insure  that  the  LCOM  results  are 
logical  and  proportionally  similar  to  the  actual  MDC  manhour 
data . 
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Uses  of  Sampling  in  Maintenance  Data  Collection 

Sampling  has  been  usee  to  collect  aircraft  maintenance 
data  on  at  least  two  occasions.  The  Air  Force  studied  the 
use  of  sampling  to  collect  manhour  data  in  1977.  In  1978, 
the  U.  S.  Army  implemented  a  sampling  concept  to  collect 
unscheduled  maintenance  data  at  specific  locations.  The 
following  sections  of  the  literature  review  discuss  these 
two  uses  of  sampling  to  collect  maintenance  data. 

MDC  Modification  Project.  In  June  1976,  HQ  USAF/LEY 
awarded  a  contract  to  Artronic  Information  Systems,  Inc., 
to  study  the  MDC  system  to  determine  whether  manhour  and 
equipment  reliability  data  requirements  could  be  satisfied 
through  the  use  of  statistical  sampling  techniques  in  place 
of  a  census  (1:1).  The  study  report,  entitled  "Project 
REALMS:  Recommendations  to  Enhance  the  Air  Logistics  Sys¬ 
tem,"  concluded  that:  the  MDC  system  did  not  provide  accu¬ 
rate  information;  the  cost  of  data  collection  was  too  high; 
the  data  documentation  was  excessive;  and  the  volume  of  data 
collected  was  so  great  that  it  was  difficult  to  sort  out  the 
desired  information.  The  study  report  recommended  the  ap¬ 
plication  of  statistical  sampling  techniques  and  trained 
observers  to  gather  manhour  data.  The  proposed  benefits  to 
be  derived  from  sampling  included:  collection  of  more  accur¬ 
ate  manhour  data;  reduction  of  manhour  documentation;  reduc¬ 
tion  of  keypunch  requirements;  and  a  reduction  in  the  amount 
of  MDC  computer  processing  time  (22:21).  The  Air  Force 
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questioned  the  technical  aspects  and  cost  effectiveness  of 
sampling  and  felt  there  was  need  for  a  test  to  evaluate  the 
impacts  of  sampling  as  recommended  by  the  contractor.  In 
July  1977/  the  Air  Force  issued  a  Program  Management  Direc¬ 
tive  (PHD)  to  the  Air  Force  Logistics  Management  Center 
(AFLMC)  tasking  them  to  design  and  conduct  a  pilot  test  of  a 
modified  MDC  system  as  described  in  the  Project  REALMS  study 
report  (1:1).  The  PMD  required  the  development  of  sampling 
schemes  which  would  provide  estimates  of  total  direct  labor 
hours  (DLH)  expended  with  a  relative  statistical  accuracy  of 
not  less  than  6  percent  for  base  level  estimates  and  not 
less  than  2  percent  for  fleet  level  estimates  by  weapon  sys¬ 
tem.  Analysis  of  this  requirement  indicated  that  it  would 
require  a  larger  number  of  observers  than  would  be  practical 
to  conduct  the  pilot  test.  As  a  result/  the  PMD  require¬ 
ments  were  modified  to  require  estimates  of  total  direct 
labor  hour?  expended  in  all  activity  at  the  base  with  10 
percent  relative  precision  and  90  percent  confidence.  These 
estimates  were  to  be  further  broken  down  by  work  center/ 

MDS/  and  work  unit  code  (5:1.1). 

Two  methods  of  estimating  total  direct  labor  hours  were 
devised,  one  called  "job  sampling"  and  the  other  called  "day 
sampling.”  Job  sampling  required  the  observation  of  a  sam¬ 
ple  of  maintenance  tasks  from  start  to  finish.  From  the 
sample  data,  an  average  DLH  per  maintenance  task  was  calcu¬ 
lated  and  multiplied  by  the  total  number  of  maintenance 
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tasks  to  determine  total  direct  labor  hours  (5:1.1).  Day 
sampling  involved  indirect  work  measurement  by  observing  a 
workcenter  supervisor  for  an  entire  eight  hour  shift,  on 
several  occasions,  to  note  work  crew  dispatches  managed  by 
the  supervisor.  This  observation  provided  an  estimate  of 
direct  labor  hours  expended  per  shift.  Total  direct  labor 
hours  were  tnen  estimated  by  multiplying  the  average  DLH 
expended  per  shift  by  the  total  number  of  shifts  during  the 
period  of  interest  (5:1.1). 

Both  sampling  plans  were  tested  during  a  five  day  pilot 
demonstration  at  Reese  APB,  Texas.  The  purpose  of  the  pilot 
demonstration  was  to  evaluate  the  administrative  complexi¬ 
ties  involved  in  applying  sampling  techniques  in  an  opera¬ 
tional  environment  (5:1.2).  Following  completion  of  the 
pilot  demonstration,  the  AFLMC  concluded  that  although  it 
wa3  technically  feasible  to  employ  either  of  the  sampling 
plans,  administrative  deficiencies  far  outweighed  their 
technical  feasibility,  it  was  felt  that  the  administrative 
deficiencies  could  severely  impact  the  success  of  the  sam¬ 
pling  methods,  resulting  in  the  potential  for  greater  inac¬ 
curate  data  collection  than  the  current  census.  As  a  result 
of  the  pilot  demonstration,  the  AFLMC  recommended  that  fur¬ 
ther  efforts  to  develop  sampling  plans  for  estimation  of 
direct  labor  hours  be  discontinued  (5:4.2).  The  PMD  was 
subsequently  rescinded  by  the  Air  Staff,  and  no  further 
research  was  conducted  into  the  use  of  sampling  to  collect 
maintenance  data. 
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The  HDC  Modification  Project  was  the  subject  of  a  1979 
Air  Porce  Audit  Agency  report.  The  audit  report  faulted  the 
study  efforts  on  a  number  of  points.  The  report  charged 
that: 


1.  The  scope,  causes,  and  problems  within  the 
existing  MDC  system  had  not  been  sufficiently 
quantified  in  measurable  terms  to  permit  an  accu¬ 
rate  assessment  of  the  effectiveness  of  sampling. 

2.  Prototype  (sampling)  design  efforts  proceeded 
without  considering  the  MDC  data  user  require¬ 
ments  and  the  impact  of  sampling  on  other  MIS 
development  projects. 

3.  The  PMD  objectives  (more  accurate  data,  re¬ 
duced  data  collection  costs,  and  reduced  techni¬ 
cian  frustration)  were  not  sufficiently  quanti¬ 
fied  to  permit  measurement  of  the  desired 
improvements  and  their  impact  on  mission  effec¬ 
tiveness  resulting  from  the  sampling  methods. 

4.  The  sampling  methods  would  not  provide  suffi¬ 
cient  failure  data  to  support  LCOM,  manhour  data 
to  support  the  manhour  per  flying  hour  program, 
and  maintenance  data  at  the  prescribed  PMD  levels 
of  accuracy. 

5.  The  sampling  plans  did  not  consider  and  would 
net  meet  the  data  requirements  for  the  revised 
LCOM  II  system  and  the  VAMOSC  system  (1:6-9). 

The  Air  Staff  response  to  these  charges  was  that  the 
MDC  Modification  Project  was  to  proceed  in  several  phases. 
The  first  phase  of  the  project  was  a  research  effort  to 
determine  if  the  Air  Force  could  develop  usable  sampling 
techniques  to  collect  maintenance  data.  The  basic  position 
of  the  Air  Staff  was  that  the  Audit  Agency’s  comments  were 
premature  because  the  ability  of  the  proposed  sampling  plans 
to  provide  data  meeting  the  requirements  of  all  users  could 
not  be  known  until  the  plans  were  fully  developed,  tested, 
and  evaluated  (1:10). 
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Army  Sample  Data  Collection  Programs.  Until  1970,  the 


U.  S.  Army  collected  maintenance  and  performance  data  on  its 
equipment  under  The  Army  Equipment  Records  System  (TAERS) , 
which  had  been  in  effect  since  1962.  The  TAERS  reporting 
and  data  collection  concepts  closely  paralleled  those  used 
in  the  Air  Porce  MDC  system.  The  TAERS  system  suffered  from 
many  of  the  same  problems  encountered  in  the  MDC  system.  In 
1968,  a  Department  of  the  Army  review  of  the  TAERS  system 
concluded: 

1.  The  system  was  non  selective  and  imposed  an 
undue  burden  on  the  troops. 

2.  The  volume  of  data  gathered  was  unmanageable 
and  its  utilization  at  the  field  and  national 
levels  was  questionable. 

3.  The  cost  of  collecting  and  processing  the 
data  was  prohibitive, 

4.  The  validity  of  the  data,  because  of  the 
conditions  under  which  it  was  collected,  was 
suspect  (19:1-2). 

These  findings  closely  resemble  those  found  in  a  number  of 
studies  of  the  Air  Porce  MDC  system  (22:44-50). 

As  a  result  of  their  findings,  the  Army  adopted  The 
Army  Maintenance  Management  System  (TAMMS)  during  the  1969- 
1970  time  frame.  The  TAMMS  eliminated  100  percent  organiz¬ 
ational  and  support  maintenance  reporting  to  the  national 
level,  except  for  aircraft.  Provisions  were  made  under  the 
new  concept  to  collect  maintenance  feedback  data,  when  need¬ 
ed  by  equipment  proponents,  through  sampling  procedures 
(19:1-2).  Under  this  sample  data  collection  (SDC)  method. 
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data  are  only  collected  on  systems  when  needed  and  fully 
justified  to  support  a  specific  purpose  (16).  Prom  an 
information  systems  standpoint,  this  requirement  forces 
identification  of  user  information  needs  before  any  data  are 
collected.  This  concept  virtually  eliminates  the  collection 
of  routine  data  which  may  or  may  not  ever  be  used.  Since 
the  inception  of  the  SDC  concept,  the  Army  reports  that  the 
SDC  program  has  cost  a  total  of  $40.3  million,  resulting  in 
a  cumulative  tangible  savings  of  $426  million — nearly  a  ten¬ 
fold  return  for  each  dollar  spent  administering  the  program 
and  collecting  the  data  (19:3). 

Sampling  Applied  to  Aviation.  In  1978,  the  Army 
implemented  sampling  in  the  collection  of  aviation  unsched¬ 
uled  maintenance  activities.  The  «rmy  definition  of  un¬ 
scheduled  maintenance,  under  the  SDC  concept,  also  includes 
time  change  and  condition  change  maintenance  actions  (15:4). 
These  actions  in  the  Air  Force  system  are  considered  sched¬ 
uled.  In  general,  the  Army  collects  the  same  type  of  main¬ 
tenance  data  through  sampling  that  the  Air  Force  collects  by 
census. 

To  understand  the  Army's  use  of  sampling  in  aviation 
maintenance,  it  is  n  essary  to  examine  the  sampling  method¬ 
ology  used.  The  basic  element  of  the  sample  is  an  Army  avi¬ 
ation  unit.  From  the  population  of  Army  aviation  units 
associated  with  a  specific  type  aircraft,  a  sample  or  units 
are  selected  to  collect  census  data  on  all  their  assigned 
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aircraft.  Thus,  some  units  collect  maintenance  data  and 
others  do  not.  The  method  of  selecting  those  units  which 
are  included  in  the  sample  requires  that  a  clarification  of 
the  use  of  sampling  be  made  from  a  statistical  viewpoint. 
Volume  I  of  the  Army  Unscheduled  Maintenance  Sample  Data 
Collection  (UMSDC)  data  collection  plan  makes  the  following 
point: 

The  SDC  data  base  was  not  originally  based  on  a 
probability  sample.  Zt  is  based  on  what  is  known 
as  a  purposive  sample.  The  Department  of  the 
Army  (DA)  designated  the  units  for  which  data 
were  to  be  collected,  based  on  administrative  and 
logistic  considerations.  In  a  situation  of  this 
kind,  the  units  designated  may  or  may  not  be 
"representative"  in  the  dictionary  3ense  which 
defines  the  term  as  "typical  of  others  of  the 
same  class."  This  definition  is  not  sufficiently 
precise  to  enable  one  to  determine  objectively 
whether  SDC  is  representative  by  a  comparison  of 
estimates  from  the  purposive  sample  with  numbers 
for  the  population  of  aircraft  known  from  another 
source.  The  best  that  can  be  done  is  a  subjec¬ 
tive  comparison.  Subjectively,  one  can  say  that 
the  SDC  figures  are  in  the  (Table  of  Equipment] 

TOE  ballpark  (17:17). 

The  use  of  a  purposive  sample  rather  than  a  probability 
sample  presents  some  difficulties  if  one  desired  to  invoke 
the  full  power  of  inferential  statistics.  In  ord^r  to  use 
the  statistical  theories,  the  sample  must  be  a  probability 
sample.  The  term  "probability  sample"  implies  that  each 
element  of  the  population  has  a  known,  non-zero  probability 
of  being  randomly  selected  for  the  sample.  The  Army  recog¬ 
nizes  that  the  data  collected  under  their  sampling  concept 
in  aviation  maintenance  is  only  directly  applicable  to  the 
units  and  aircraft  in  the  sample  from  a  statistical  point  of 
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view.  Although  no  "proof"  exists  that  the  data  collected  is 
representative  of  the  population,  the  Army  treats  the  data 
as  though  it  is  representative  mindful  of  the  possibility 
that  it  may  not  be  representative. 

Comparison  of  Army  UMSDC  and  Air  Force  MDC  Systems 

This  section  provides  a  side  by  side  comparison  between 
the  MDC  and  UMSDC  data  collection  systems.  It  compares  the 
database  design  and  format,  the  data  elements,  and  the  out¬ 
put  products. 

UMSDC  Database  Design.  The  basic  design  philosophy 
benind  the  UMSDC  database  was  to  provide  feedback  of  field 
operational  and  maintenance  characteristics  of  Army  nardware 
for  comparison  with  design  predictions.  The  system  was  de¬ 
signed  primarily  to  collect  reliability,  maintainability, 
and  availability  data,  with  maintenance  management  informa¬ 
tion  as  a  by  product  (17:1).  The  MDC  system,  on  the  other 
hand,  was  designed  primarily  to  provide  maintenance  manage¬ 
ment  information,  with  reliability  and  maintainability  data 
as  a  by-product  (22:344). 

The  Army  utilizes  the  Reliability,  Availability,  Main¬ 
tainability  and  Logistics  (RAMLOG)  data  collection  system  to 
capture  all  generated  operational  and  maintenance  data  dur¬ 
ing  the  test  and  evaluation  phase  of  equipment  acquisition, 
employing  the  use  of  trained  observers  to  collect  the  data. 
This  concept  would  be  costly  and  impractical  beyond  the  test 
environment.  Thus,  the  UMSDC  system  is  used  to  continue  the 
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operational  and  maintenance  data  collection  started  during 
the  test  and  evaluation  phase  Cor  the  duration  o£  the  equip¬ 
ment  life  cycle.  The  UMSDC  data  collection  effort  is  con¬ 
ducted  on  a  more  limited  scale  than  the  RAM/LOG  effort,  us¬ 
ing  regular  field  personnel  to  collect  the  data,  in  addi¬ 
tion,  the  RAM/LOG  and  UMSDC  system  data  elements  are  based 
on  the  same  data  elements  developed  and  used  for  the  Logis¬ 
tics  Support  Analysis  Record  (LSAR) .  The  LSAR  is  developed 
during  weapon  system  design  by  the  contractor  designing  the 
system.  The  result  is  a  data  base  providing  the  same  infor¬ 
mation  relating  to  any  phase  of  the  equipment  life  cycle 
(15:1;  18:4-5).  The  Air  Porce  has  no  such  comparable  system 
to  collect  the  same  information  during  both  the  test  and 
operational  phases  of  the  equipment  life  cycle. 

UMSDC  Database  Format.  The  data  collected  in  the 
UMSDC  system  are  stored  in  an  automated  data  processing  for¬ 
mat  compatible  witn  the  Statistical  Analysis  Software  (SAS) 
System,  a  powerful  statistical  software  package,  which  is 
resident  on  the  computer  used  with  the  UMSDC  system.  This 
setup  allows  the  easy  use  of  the  various  statistical  analy¬ 
sis  routines  without  requiring  extensive  data  manipulation 
(17:8).  The  Air  Porce  MDC  system  has  no  statistical  analy¬ 
sis  software  associated  with  it.  Detailed  statistical  anal¬ 
ysis  of  MDC  data  is  not  possible  without  extensive,  usually 
manual,  data  manipulation.  Although  the  MDC  system  provides 
census  data  and  does  not  necessarily  require  this  software 
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for  statistical  inference  purposes,  there  are  many  other 
statistical  tests  which  could  provide  valuable  analysis  of 
the  data.  For  example,  statistical  tests  could  be  performed 
to  check  for  significant  changes  in  parameters  over  time  or 
significant  differences  between  bases  and  systems.  Regres¬ 
sion  analysis  can  also  be  performed  to  measure  linear  rela- 
tionsnips  between  data  elements.  The  UMSDC  database  is  de¬ 
signed  with  this  analysis  capability  in  mind.  The  MDC  sys¬ 
tem  was  not  designed  for  this  purpose,  although  the  MODAS 
system  does  provide  a  limited  regression  analysis  capability 
to  plot  trend  information. 

QMS DC  Database  Elements .  The  data  elements  captured 
through  the  UMSDC  program  provide  a  basis  for  determining  a 
significant  number  of  RAM/LOG  effectiveness  measures,  such 
as  readiness,  mission  reliability,  and  support  costs.  UMSDC 
was  designed  to  provide  the  most  accurate  possible  determin¬ 
ation  of  these  measures.  Table  I  provides  a  comprehensive 
overview  of  the  effectiveness  measures  directly  supported  by 
the  UMSDC  data  elements  (17:21). 

UMSDC  provides  information  concerning  operations,  main¬ 
tenance,  and  supply  in  one  information  system.  Data  ele¬ 
ments  are  recorded  showing  the  effects  of  each  area  on  the 
other  two.  Specific  data  elements  are  recorded  to  show  the 
effect  of  a  malfunction  on  a  mission;  the  source  of  the 
parts  used  to  make  the  repair;  and  the  reasons  for  mission 
delays.  For  example,  such  information  could  show  that  a 
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TABLE  I 


Weapon  System  Effectiveness  Measures 
Supported  by  UMSDC  Data  Elements 


Reliability 

Availability 

Maintainability 

MTBF 

System  Reliability 
Mission  Reliability 
MTBR 

MTBM 

MTB  Red  X  Events 

Inherent 

Achieved 

Operational 

MTTR 

Unscheduled  MM/FH 
Scheduled  MM/FH 

MOS  Utilization 
Direct  MH/FH 
Indirect  MH/FH 

Operations 

Logistics 

Cost 

Mission  Abort  Rate 
Usage  Rate 

POL  Usage 

Parts  Usage 
Ordnance  Expended 
Parts  Delays 

Cost/FH 

Source:  Army  Sample  Data  Collection  Plan,  Aviation 
Applications  Guide,  Volume  1,  Fig.  6. 


partial  equipment  failure  caused  degraded  mission  perfor¬ 
mance;  that  a  part  had  to  be  cannibalized  because  a  spare 
was  not  available;  or  that  a  mission  was  delayed  due  to  a 
repair  that  could  not  be  made  because  the  proper  tools  or 
test  equipment  were  not  available  (15).  This  type  of  infor¬ 
mation  is  not  available  from  the  Air  Force  MDC  system,  al¬ 
though  some  of  the  information  concerning  mission  delays  is 
available  through  other  data  collection  and  reporting  sys¬ 
tems.  In  the  UMSDC  system,  these  data  can  easily  be  related 
to  each  other,  while  in  the  Air  Force  system  they  cannot. 
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TABLE  II 
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Comparison  of  MDC  and  UMSDC  Data 


MDC  System 

UMSDC  System 

Job  Control  Number 

Work  Order  Control  Number 

Workcenter  Code 

Unit  Identification  Code 

Identification  Number 

Aircraft  Serial  Number 

Standard  Reporting 

Model  No.,  Serial  No., 

Designator 

Location  .  ^ 

All  unscheduled1  * 

Type  Maintenance 

Work  Unit  Code 

Work  Unit  Code 

Action  Taken  Code 

Action  Code 

How  Malfunction  Code 

Failure  Code 

When  Discovered  Code 

When  Discovered  Code 

Category  of  Labor 

Direct  Labor  Only2 

Manhours 

Direct  Manhours^ 

- 3 

Malfunction  Effect  Code 

— 

How  Recognized  Code 

— 

Transaction  Code 

Delay  Code 

- - 

Aircraft  Status  Code 

— - 

Function  Code 

Base  Code 

Location  Code 

- 4 

Level  of  Repair 

Employee  Number/AFSC 

Personnel  Identification 
Code 

Parts  Replaced 

Parts  Consumed 

5 

Narrative  Description 

^Includes  TCTO  and  modifications. 

2UMSDC  only  records  direct  "hands  on"  manhours  expended 
during  actual  maintenance  and  does  not  apply  to  time 
consumed  for  parts/tool  chasing. 

3Two  when  discovered  codes  in  the  MDC  system  are  related 
to  mission  aborts. 

4 

Air  Force  has  a  separate  data  collection  system  for 
depot  repair. 

5MDC  has  provisions  for  narrative  description  on  the  AFTO 
Form  349;  however,  it  is  not  entered  into  data  system. 
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A  side  by  side  comparison  of  the  Army  UMSDC  and  the  Air 
Force  HOC  coded  data  elements  is  provided  in  Table  II.  In 
general,  the  data  collected  in  the  HDC  system  are  also  col¬ 
lected  in  the  (JMSDC  system.  However,  the  UMSDC  system  pro¬ 
vides  the  additional  data  elements  described  below  (17:15- 
16) : 

a.  Malfunction  Effect  Code.  This  code  describes 
the  actual  effect  a  particular  failure  had  on  the  ability  to 
complete  a  scheduled  mission.  The  MDC  system  provides  lim¬ 
ited  mission  effect  data  in  conjunction  with  the  When  Dis¬ 
covered  code. 

b.  How  Recognized  Code.  This  code  relates  how 
the  fault  or  symptom  of  trouble  was  first  recognized,  such 
as  cockpit  display,  noise,  or  vibration. 

c.  Transaction  Code.  This  code  indicates  the 
supply  source  of  the  replacement  part,  such  as  from  base 
supply  or  cannibalization. 

d.  Delay  Code.  This  code  indicates  the  reason 
for  a  mission  delay  as  a  result  of  a  failure  that  could  not 
be  repaired.  For  example,  non  availability  of  parts,  per¬ 
sonnel,  support  equipment,  or  tools  would  be  reported  here 
as  the  reason  for  delay. 

e.  Aircraft  Status  Code.  This  code  indicates 
the  effect  of  a  failure  on  the  airworthiness  of  the  air¬ 
craft.  For  example,  the  letter  code  X  indicates  the  fail¬ 
ure  caused  grounding  of  the  aircraft. 
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f.  Function  Code.  This  code  is  used  to  compare 


the  type  of  maintenance  actions  actually  performed  to  the 
contractor  estimates  determined  as  part  of  the  Logistics 
Support  Analysis  during  the  initial  design.  This  data 
element  captures  the  amount  of  calibration,  adjustment  or 
cleaning  required  to  keep  a  component  functioning  properly. 

UMSDC  Operations  Data.  In  addition  to  pure  maintenance 
data,  the  (JMSDC  system  also  collects  operational  data  simi¬ 
lar  to  the  data  collected  by  the  Air  Force  in  the  Aircraft 
Status  and  Inventory  Utilization  System.  The  collection  of 
operations  data  was  not  originally  a  part  of  the  UMSDC  sys¬ 
tem.  However,  the  Army  felt  that  the  full  maintenance  pic¬ 
ture  could  not  be  understood  unless  the  operation  of  the 
unit  was  also  known  (18:5).  The  operations  data  collected 
by  the  Army  in  the  UMSDC  program  include  the  following: 
flight  hour  accumulations;  flight/mission  results;  aircraft 
and  weapon  system  status;  cargo  loads,  passengers,  and  spe¬ 
cial  equipment  transported;  fuels  and  ordnance  consumed; 
type  mission;  and  flight  crew  identification  (15:7). 

While  similar  operations  data  are  also  collected  by  the 
Air  Force,  the  significant  difference  between  MDC  and  UMSDC 
is  that  the  Army  collects  all  the  data  in  one  system,  and 
the  data  are  directly  related  to  each  other.  This  makes 
data  analysis  easier  and  produces  more  meaningful  informa¬ 
tion.  In  the  Air  Force  system,  it  is  difficult  to  directly 
relate  the  impact  of  maintenance  on  operations  and  vice- 
versa  beyond  an  aggregate  measure. 
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Summary  of  Differences .  The  comparison  between  the 
Army  and  the  Air  Force  data  collection  systems  shows  a 
basic  similarity  in  the  maintenance  data  collected  by  each 
service.  The  major  differences  noted  were: 

a.  The  Army  collects  only  unscheduled  maintenance  and 
"hands  on"  man-hour  data,  while  the  Air  Force  col¬ 
lects  all  maintenance  and  manhour  data. 

b.  the  Arm*  system  is  designed  specifically  to  collect 
field  '/  i  M  data,  while  the  Air  Force  system  pro¬ 
vides  this  information  as  a  by  product. 

c.  the  Army  collects  several  additional  useful  data 
elements  not  found  in  the  the  Air  Force  MDC  system. 

d.  the  Army  collects  census  data  on  all  aircraft  at 
specific  locations,  while  the  Air  Force  collects 
census  data  on  all  aircraft  at  all  locations. 

It  should  be  noted  that  as  a  result  of  sampling,  the  Army  is 

able  to  collect  more  detailed  information  than  would  be 

economically  and  administratively  possible  using  a  complete 

census. 

Summary 

The  purpose  of  this  literature  review  is  to  provide 
general  background  information  regarding  the  structure  of 
the  MDC  system,  the  uses  of  MDC  data,  and  the  application  of 
sampling  techniques  to  maintenance  data  collection.  It  also 
provides  a  detailed  comparison  between  the  MDC  system  and 
the  Army  Unscheduled  Maintenance  Sample  Data  Collection 
(UMSDC )  program,  so  that  the  reader  may  have  an  appreciation 
of  the  detailed  data  that  can  be  collected  when  sampling  is 
used  to. reduce  the  data  collection  effort. 
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III.  Methodology 


Introduction 

This  chapter  provides  a  description  of  the  methodology 
used  to  answer  t'ie  research  questions  posed  in  chapter  I  and 
presents  an  outline  of  the  analysis  to  follow. 

Background 

This  section  presents  the  preliminary  research  that  was 
conducted  prior  to  the  development  of  the  sampling  plans. 

It  describes  the  parameters  of  interest  and  the  precision 
requirements  selected  for  the  study. 

MDC  Data  Base.  The  first  step  in  this  research  effort 
was  a  review  of  pertinent  literature  concerning  the  MDC  sys¬ 
tem.  This  provided  a  thorough  understanding  of  the  MDC  sys¬ 
tem:  the  data  collected;  the  structure  of  the  data  base; 
the  data  collection  process;  and  the  ultimate  users  of  MDC 
data  in  other  information  systems.  This  review  was  essen¬ 
tial  in  order  to  develop  a  sampling  scheme  to  collect  the 
same  data  currently  collected  by  census,  and  to  evaluate  the 
impact  of  sampling  on  the  users  of  MDC  data.  A  summary  of 
this  review  is  contained  in  the  literature  review  of  chapter 
II. 

Previous  Sampling  Studies.  Sampling  techniques  have 
been  used  previously  to  collect  maintenance  data  with  vary¬ 
ing  degrees  of  success.  Thus,  the  next  step  in  the  research 
process  was  an  examination  of  the  previous  uses  of  sampling 
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to  determine  where  it  had  been  successful  and  where  it  had 
failed.  The  intent  was  to  capitalize  on  the  successes  and 
avoid  the  reasons  for  failure.  Specifically,  the  U-S.  Army 
Aviation  Unscheduled  Maintenance  Sample  Data  Collection  Pro¬ 
gram  (UMSOC)  and  the  Air  Force  Logistics  Management  Center 
(AFLMC)  MDC  Modification  Project  were  investigated  in  depth. 

Need  for  Census  Data.  Sampling  techniques  cannot  and 
should  not  be  considered  an  option  in  all  cases.  Although 
sampling  could  reduce  the  M DC  data  collection  effort,  some 
form  of  census  data  collection  is  unavoidable.  For  example, 
a  permanent  record  of  all  operations,  discrepancies,  and 
maintenance  performed  on  each  aircraft  is  needed  to  monitor 
the  condition  of  the  aircraft.  Whenever  a  failure  or  dis¬ 
crepancy  occurs  and  maintenance  is  performed,  the  following 
information  is  recorded  in  permanent  aircraft  records 
(called  aircraft  "forms"): 

1.  description  of  the  failure  or  problem 

2.  conditions  present  at  the  time  the  failure  or  prob¬ 
lem  was  encountered 

3.  on  equipment  corrective  action  taken 

Also  recorded  in  the  forms  is  the  job  control  number  assign¬ 
ed  to  each  reported  failure.  This  number  is  used  by  main¬ 
tenance  control  to  keep  track  of  the  maintenance  status  of 
each  aircraft. 

Currently,  all  failure  and  maintenance  information  for 
each  discrepancy  recorded  in  each  aircraft's  forms  is  also 
recorded  on  AF  Form  349s,  along  with  other  details  required 
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by  MDC.  Under  the  proposed  sampling  scheme  presented  in 
this  chapter,  only  data  on  the  aircraft  included  in  the  sam¬ 
ple  would  require  recording  and  processing  through  MOC. 
However,  the  information  described  above  would  still  need  to 
be  recorded  in  the  forms  on  all  aircraft,  with  an  automated 
maintenance  system  concept,  the  aircraft  forms  are  maintain¬ 
ed  and  printed  by  the  computer.  The  computer  could  be  pro¬ 
grammed  to  maintain  a  failure  count  by  aircraft  and  work 
unit  code,  using  the  data  in  the  aircraft  forms.  This  could 
provide  a  method  of  collecting  census  failure  data  outside 
of  the  HOC  system.  Summary  failure  counts  by  work  unit  code 
could  be  compiled  at  base  level  and  forwarded  to  AFLC  by 
each  base.  Such  a  concept  could  provide  the  necessary  fail¬ 
ure  data  needed  by  AFLC  without  having  to  process  and  trans¬ 
mit  all  the  data  currently  processed. 

In  addition  to  the  information  recorded  in  the  aircraft 
forms,  a  count  of  no  defect  failures  would  also  need  to  be 
reported  by  census.  Total  failures  consist  of  type  1  (in¬ 
herent)  ,  type  2  (induced),  and  type  6  (no  defect)  failures. 

A  discrepancy  documented  in  the  aircraft  forms  as  a  type  1 
failure  may  involve  removal  and  replacement  of  a  component. 
This  "failed"  component,  when  tested  in  the  shop,  may  not 
indicate  a  failed  condition.  Thus,  what  was  recorded  as  a 
type  1  failure  is  now  reclassified  as  a  type  6  failure.  In 
order  to  insure  an  accurate  failure  count  by  type,  these 
changes  in  type  failure  must  be  reported.  Since  the  dis- 
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ccepancy  had  a  job  control  number  assigned  to  it  initially, 
the  computer  could  be  instructed  to  change  the  type  failure 
code  for  that  job. 

Lastly,  those  components  on  which  lifetime  data  are 
being  tracked  by  serial  number  will  require  that  data  be 
collected  by  census.  This  is  necessary  to  provide  complete 
data  for  reliability  analysis. 

Parameters  of  interest.  Basic  to  any  sampling  plan  is 
the  determination  of  what  parameters  are  to  be  estimated. 

Two  parameters  of  general  interest  derived  from  MDC  data  are 
the  Mean  Time  Between  Maintenance  (MTBM)  and  the  Maintenance 
Manhours  per  Flying  Hour  {MM/FH) .  MTBM  provides  an  indica¬ 
tion  of  system  reliability,  while  MM/FH  provides  an  indica¬ 
tion  of  system  maintainability.  MTBM  is  determined  by 
dividing  total  operating  hours  by  the  total  failure  count. 
Since  total  failure  counts  could  be  maintained  by  census,  as 
described  previously,  there  is  no  need  to  estimate  MTBM  by 
sampling.  In  this  research,  the  proposed  sampling  plans  are 
designed  to  estimate  total  unscheduled  maintenance  manhours 
from  which  unscheduled  MM/FH  can  be  estimated  by  dividing 
the  estimated  total  unscheduled  manhours  by  the  actual  popu¬ 
lation  total  flying  hours.  Manhours  is  chosen  simply  to 
illustrate  the  sample  size  required  and  should  not  be  con¬ 
strued  as  the  only  data  element  to  be  collected  by  sampling. 
An  implicit  assumption  is  made  that  this  sample  size  would 
result  in  the  collection  of  other  failure  and  maintenance 
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details  in  sufficient  quantity  to  satisfy  the  requirements 
of  most  MDC  users. 

Sampl ing  Precision.  Once  the  parameter  of  interest  is 
identified,  the  degree  of  precision  with  which  the  parameter 
is  to  be  estimated  must  be  addressed.  The  required  degree 
of  precision  for  maintenance  manhour  estimates  was  not  read- 
ily  available.  Since  the  current  census  data  collection 
theoretically  provides  true  manhour  statistics  with  100  per-* 
cent  statistical  confidence  (assuming  the  data  are  accu¬ 
rate)  ,  the  issue  of  sampling  precision  has  yet  to  be 
surfaced  within  the  maintenance  community. 

A  review  of  other  sampling  studies  provided  an  indica¬ 
tion  of  the  sampling  precision  that  might  be  acceptable  to 
maintenance  management.  Of  the  two  previous  uses  of  sam¬ 
pling  to  collect  maintenance  data,  only  the  AFLMC  study 
specified  any  precision  requirement.  The  Army  does  not  use 
a  random  sampling  scheme;  therefore,  no  statistical  preci¬ 
sion  is  applicable.  The  Program  Management  Directive  (PMD 
guiding  the  AFLMC  study  stipulated  that  sampling  should 
provide  estimates  of  total  direct  labor  hours  expended  in 
all  maintenance  activity  at  the  base  level  with  10  percent 
relative  precision  and  90  percent  confidence.  Zn  the  ab¬ 
sence  of  firm  requirements,  these  precision  requirements 
were  adopted  as  a  starting  point  for  this  research. 

The  proposed  sampling  plans  will  be  designed  to  provide 
estimates  of  the  base  total  monthly  unscheduled  maintenance 
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manhours  at  the  two  digit  work  unit  code  (system)  level  with 
10  percent  relative  precision  and  90  percent  confidence.  If 
these  precision  guidelines  result  in  the  requirement  for  a 
very  large  sample  size/  the  degree  of  precision  that  can  be 
achieved  with  a  smaller  sample  will  be  illustrated  for  pos¬ 
sible  consideration  by  management. 

Sampling  Plans 

Unscheduled  maintenance  jobs  are  tracked  either  via  the 
maintenance  Job  Control  Number  (JCN)  assigned  each  time  a 
failure  is  reported;  or  via  the  Serial  Number  (SN)  of  the 
aircraft  on  which  the  failure  occurs.  Sampling  plans  could 
be  centered  on  either  one  of  these  methods.  However/  a  sam¬ 
pling  plan  centered  on  the  JCN  was  already  evaluated  during 
the  AFLMC  HOC  Modification  Project.  It  required  a  rather 
large  sample  size  and  was  determined  to  be  infeasible  due  to 
administrative  complexities.  Considering  the  AFLMC  study 
result?,  this  research  effort  will  evaluate  a  sampling  con¬ 
cept  centered  on  the  aircraft  serial  number. 

Serial  Number  Sampling.  A  Serial  Number  (SN)  sampling 
plan  could  be  based  on  a  simple  random  sample  of  aircraft  by 
serial  number.  Each  month  an  appropriate  number  of  aircraft 
could  be  randomly  identified  by  serial  number  to  be  included 
in  the  sample.  Census  data  would  then  be  collected  on  each 
aircraft  in  the  sample  during  the  month.  Data  collection 
would  be  identical  to  the  data  currently  collected  from  the 
entire  population  by  census. 
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Serial  Number  Sampling  would  provide  failure  counts, 
total  unscheduled  manhours,  and  other  failure  and  mainten¬ 
ance  details,  by  work  unit  code  for  each  aircraft  in  the 
sample.  Maintenance  manhours  could  be  summed  by  work  unit 
code  for  each  aircraft  in  the  sample.  Total  sample  manhours 
could  be  obtained  by  summing  the  individual  aircraft  values. 
Then  the  average  unscheduled  manhours  per  aircraft  would  be 
determined  by  dividing  total  unscheduled  manhours  for  each 
work  unit  code  by  the  total  number  of  aircraft  in  the  sam¬ 
ple.  An  estimate  of  base  total  unscheduled  manhours  would 
result  from  multiplying  the  average  unscheduled  manhours  per 
aircraft  by  the  total  number  of  aircraft  assigned  to  the 
base.  Unscheduled  maintenance  manhours  per  flying  hour  may 
then  be  estimated  by  dividing  estimated  total  unscheduled 
manhours  by  the  actual  base  total  fleet  operating  hours. 

Sample  Design 

This  section  presents  information  relating  specific¬ 
ally  to  the  design  of  the  sampling  plan.  The  discussion 
covers  topics  such  as  the  relevant  population,  sampling 
frame,  sampling  unit,  type  sampling,  and  data  collection. 

Relevant  Population.  The  population  of  interest  using 
a  serial  number  sampling  plan  is  the  entire  fleet  of  a  par¬ 
ticular  model  of  aircraft  assigned  to  an  individual  base 
during  a  specified  period  of  time.  The  relevant  population 
arbitrarily  selected  for  study  in  this  research  effort  is 
the  fleet  of  F-16A  aircraft  assigned  to  Hahn  Air  Base,  Ger- 
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many  during  the  November  1984  through  April  198S  time  frame. 

Sampling  Frame.  A  sampling  frame  is  a  list  of  elements 
comprising  the  population  from  which  the  sample  is  actually 
drawn  (20:151).  The  sampling  frame  for  this  study  is  the 
list  of  all  P-16A  aircraft  assigned  to  Hahn  AB  during  the 
period  stated  above.  A  listing  of  aircraft  by  serial  number 
and  base  of  assignment  can  be  obtained  through  the  G033B 
Aircraft  Status  Inventory  and  Utilization  System. 

Sampling  Unit.  Each  aircraft  in  the  sampling  frame 
comprises  a  sampling  unit.  Each  sampling  unit  consists  of  a 
number  of  subunits,  the  aircraft  systems.  As  previously 
discussed,  the  parameter  of  interest  for  illustrr.cing  sample 
size  requirements  is  unscheduled  maintenance  manhours.  The 
total  unscheduled  manhours  associated  with  each  system  on 
the  aircraft  is  the  parameter  of  interest  for  this  study. 

To  illustrate  the  procedures  used  to  evaluate  sample  size, 
all  unscheduled  maintenance  activity  on  one  system,  the 
F-16A  Fire  Control  System  (work  unit  code  74XXX) ,  on  each 
aircraft  in  the  sampling  frame  will  be  considered  the  sam¬ 
pling  unit. 

Type  Sampl ing .  Random  sampling  in  the  serial  number 
sampling  plan  is  actually  a  special  case  of  simple  cluster 
sampling,  with  many  clusters  consisting  of  one  aircraft 
each.  In  this  situation,  simple  random  sampling  and  simple 
cluster  sampling  are  identical,  since  the  only  difference 
between  the  two  is  in  the  size  of  the  cluster  (20:175). 


53 


Cluster  sampling  involves  dividing  the  population  into  many 
subgroups  according  to  some  criterion  or  ease  of  availabil¬ 
ity  in  data  collection.  Ideally  these  subgroups  or  clusters 
should  display  heterogeneity  within  groups  and  homogeneity 
between  groups.  A  random  sample  of  clusters  is  selected  and 
each  cluster  is  then  typically  studied  in  toto  (20:172). 
Using  the  unscheduled  maintenance  activity  for  each  individ¬ 
ual  aircraft  as  the  sampling  unit  makes  simple  cluster  sam¬ 
pling  practical,  as  each  aircraft  represents  a  "natural 
cluster"  of  maintenance  activity.  As  natural  clusters,  all 
maintenance  activity  on  each  aircraft  is  heterogeneous,  as 
each  aircraft  contains  a  wide  variety  of  systems,  each  re¬ 
quiring  maintenance  at  different  times.  Likewise,  all  main¬ 
tenance  activity  between  clusters  is  homogeneous,  as  each 
aircraft  of  a  given  model  will  generally  require  approxi¬ 
mately  the  same  type  and  quantity  of  maintenance  over  time. 
The  individual  aircraft  meet  the  requirements  for  acceptable 
clusters:  heterogeneity  within  clusters  and  homogeneity 
between  clusters. 

Data  Collection.  To  evaluate  the  application  of  sam¬ 
pling  to  the  collection  of  unscheduled  maintenance  data,  it 
is  necessary  to  analyze  the  historical  data  to  evaluate  the 
characteristics  of  the  parameter  of  interest.  Data  collec¬ 
tion,  in  this  section,  refers  to  the  collection  of  this  his¬ 
torical  data  for  analysis,  rather  than  the  collection  of 
data  by  sampling. 
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MDC  data  used  in  the  analysis  will  be  obtained  from  the 
HOOAS  system  Monthly  Detailed  Maintenance  Data  Search 
Reports.  The  reports  will  list,  by  aircraft  serial  number, 
all  unscheduled  "A”  on  equipment  records  and  "H"  off  equip* 
ment  records  for  the  Pire  Control  System  on  the  F-16A  air¬ 
craft  assigned  to  Hahn  AB  between  November  1984  and  April 
1985.  Manhours  and  total  failure  counts  will  be  extracted 
from  these  reports  for  further  analysis.  Total  operating 
hours  and  failure  counts  by  month  for  the  base  fleet  can  be 
acquired  from  a  MODAS  Reliability  Report.  Summary  base 
monthly  manhour  data  can  be  obtained  from  a  MODAS  Summary 
Pailure  Data  List. 

Sample  Size  Determination 

The  primary  factor  that  determines  whether  sampling  by 
aircraft  serial  number  is  a  practical  and  effective  method 
of  data  collection  is  the  size  of  the  sample  required  to 
insure  the  precision  requirements  are  met.  The  initial 
focus  of  the  analysis  will  therefore  be  on  demonstrating  how 
the  sample  size  can  be  determined. 

Sample  Size  Calculation.  Since  simple  cluster  and  sim¬ 
ple  random  sampling  are  identical  in  this  sampling  design, 
it  is  possible  to  use  the  sample  size  formulas  derived  for 
simple  random  sampling.  With  precision  stated  in  relative 
terms  and  sampling  conducted  without  replacement,  Equation 
(1)  can  be  used  to  calculate  the  required  sample  size 
(32:83-86): 
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n 


(1) 


N  [(Z) (C) I  2 
N  d2  +  [ (Z) (C) ] 2 


where 

n  ■  required  sample  size 

N  ■  population  size 

Z  ■  normal  Z  score  corresponding  to  the 
desired  level  of  confluence 

C  ■  coefficient  of  variation 

d  *  desired  relative  precision  of  the 
parameter  to  be  estimated,  stated 
in  percent 

The  sample  size  is  driven  primarily  by  the  degree  of 
variability  of  the  parameter  of  interest  and  the  degree  of 
statistical  precision  required.  As  previously  discussed, 
the  precision  requirements  of  10  percent  relative  precision 
with  90  percent  statistical  confidence  as  stated  in  the  PMD 
guiding  the  AFLMC  MDC  Modification  Project,  will  be  applied 
to  this  study  as  well.  Therefore,  the  focus  of  this  section 
will  be  on  examining  the  degree  of  variability  in  manhours 
per  aircraft  as  the  determinant  of  sample  size. 

Coefficient  of  Variation.  The  coefficient  of  varia¬ 
tion,  C,  is  defined  as  the  ratio  of  the  population  standard 
deviation  to  the  population  mean.  It  can  also  be  estimated 
by  the  ratio  of  the  sample  standard  deviation  to  the  sample 
mean  (32:83-86).  Fortunately,  data  concerning  the  entire 
population  is  available;  therefore,  it  is  simple  to  deter¬ 
mine  the  actual  population  mean  and  standard  deviation  of 
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the  parameter  of  interest.  The  coefficient  of  variation  can 
then  be  accurately  determined  by  simply  taking  the  ratio  of 
the  two.  All  values  can  then  be  entered  into  equation  (1) 
to  determine  the  number  of  aircraft  that  would  have  been  re¬ 
quired  in  the  sample,  based  on  historical  data,  to  estimate 
the  total  monthly  base  unscheduled  maintenance  manhours  at 
the  two  digit  WUC  level  with  10  percent  relative  precision 
and  90  percent  confidence. 

The  determination  of  the  sample  size  that  would  have 
been  required,  after  the  census  data  has  already  been  col¬ 
lected,  may  or  may  not  be  of  value  in  determining  the  sample 
size  required  to  collect  future  data.  If  it  can  be  demon¬ 
strated  that  historically  the  variability  of  the  data  is 
nearly  constant  over  time,  the  sample  size  required  to  col¬ 
lect  future  data  can  be  fixed  accurately.  However,  if  the 
variability  is  changing  over  time,  the  task  is  more  diffi¬ 
cult.  In  that  case,  the  techniques  in  the  following  section 
may  be  used  to  fix  the  sample  size. 

Sample  Size  With  Changing  Variability.  Three  possible 
techniques  that  could  be  used  to  determine  the  required 
sample  size  if  the  variability  of  the  data  is  known  to  be 
changing  over  time  are  proposed  in  this  section.  They  are 
referred  to  as  the  "worst  case,”  "average  case,”  and 
"prediction"  methods. 

Using  the  worst  case  method,  the  sample  size  is  fixed 
to  satisfy  the  precision  requirements  for  those  months  when 
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the  data  variability  is  greatest.  The  resulting  sample  size 
would  be  larger  than  necessary  during  some  months,  but  would 
be  adequate  to  satisfy  all  precision  requirements  over  time. 
In  fact,  the  sample  size  might  be  quite  large,  since  it 
would  be  based  on  the  highest  variability  exhibited  by  any 
system  on  the  aircraft  in  the  past.  However,  using  this 
technique  the  minimum  statistical  accuracy  expected  to  be 
attained  would  be  known  with  some  degree  of  certainty.  On 
the  average,  assuming  no  radical  change  in  variability 
occurs,  statistical  accuracy  would  be  above  the  minimum 
required,  but  in  almost  no  case  would  it  be  lower. 

Using  the  average  case  method,  the  sample  size  is  fixed 
to  satisfy  the  precision  requirements  based  on  the  average 
variability  of  the  parameter  of  interest  over  a  period  of 
time,  say  one  year.  The  resulting  sample  size  would  be 
greater  than  necessary  during  some  months  when  the  actual 
variability  is  lower  than  the  past  average,  but  would  be 
less  than  required  when  the  actual  variability  is  higher. 
Thus,  attained  statistical  precision  would  fluctuate  around 
the  desired  value. 

If  it  is  possible  to  predict  the  variability  of  the 
data  over  time  with  some  degree  of  confidence,  a  more  accu¬ 
rate  sample  size  can  be  determined  for  each  time  period 
using  the  prediction  method.  Thus,  if  the  variability  was 
predicted  to  be  low,  a  smaller  sample  would  be  needed,  and 
vice-versa.  Such  a  prediction  might  be  possible  using  some 
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type  of  a  time-series  forecasting  technique,  if  there  is  a 
time  dependency  such  as  seasonality  in  the  data.  Some 
degree  of  seasonality  would  be  expected  in  an  analysis  of 
past  data.  For  example,  seasonal  patterns  have  been  known 
to  affect  the  performance  of  certain  aircraft  systems.  Sea¬ 
sonal  patterns  caused  by  weather  or  operational  commitments 
may  impact  how  the  aircraft  are  operated;  how  many  flight 
hours  are  accumulated;  and  how  and  when  maintenance  can  be 
performed  or  will  be  required.  However,  other  factors  which 
cannot  be  predicted,  such  as  a  change  in  operating  and  main¬ 
tenance  policies  or  concepts;  technician  experience  levels; 
or  source  of  spare  parts  may  also  contribute  to  the  data 
variability.  These  non-seasonal  and  unpredictable  effects 
could  seriously  impact  the  forecast  accuracy  of  future  vari¬ 
ability.  However,  if  a  reliable  forecasting  technique  were 
developed,  the  sample  size  requirement  could  be  fixed  more 
accurately  than  using  either  of  the  other  two  methods. 

Data  Analysis 

This  section  presents  the  preliminary  analysis  to  be 
conducted  on  the  historical  data  base  to  determine  how  the 
sample  size  must  be  determined  and  what  statistical  analysis 
needs  to  be  performed. 

Level  of  Analysis.  The  level  of  detail  at  which  to 
conduct  a  complete  analysis  will  be  determined  after  a  pre¬ 
liminary  analysis  of  the  historical  data.  Data  will  ini¬ 
tially  be  obtained  at  the  two  digit  (system),  three  dig't 
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(sub-system) ,  and  five  digit  (component)  work  unit  code 
(WUC)  levels  of  detail  fot  the  Fire  Control  System.  A  ran¬ 
dom  sample  of  ten  aircraft  will  be  selected  for  each  of  the 
six  months  of  data  to  be  analyzed.  Total  unscheduled  main¬ 
tenance  manhours  will  be  calculated  for  each  of  the  ten  air¬ 
craft  at  each  level  of  detail.  The  sample  mean,  standard 
deviation,  and  coefficient  of  variation  of  unscheduled  man¬ 
hours  per  aircraft  can  then  be  calculated  for  each  monthly 
sample  at  each  WUC  level.  The  coefficients  of  variation 
will  then  be  compared  for  each  month  at  each  WUC  level  to 
determine  which  level  has  the  least  variability  between  air¬ 
craft.  The  same  analysis  will  be  conducted  using  the  six 
month  pooled  sample  data  at  each  of  the  three  levels.  The 
level  of  detail  exhibiting  the  least  variability  will  be 
used  in  all  further  analysis,  since  the  lower  variability 
would  require  a  smaller  sample  size. 

Manhour  Calculations .  Once  the  level  of  detail  for 
analysis  has  been  selected,  the  entire  population  data  at 
that  level  will  be  subjected  to  statistical  analysis  tests. 
Considering  the  volume  of  data  to  be  analyzed,  a  simple  For¬ 
tran  computer  program  will  be  used  to  calculate  the  manhours 
from  the  start  time,  stop  time,  and  crew  size  reported  on 
each  MDC  data  record.  The  program  will  sum  on  and  off 
equipment  manhours  separately  by  aircraft  serial  number  for 
each  month.  Total  manhours  per  aircraft  will  then  be  com¬ 
puted  manually  by  summing  the  on  and  off  equipment  manhours. 
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Those  aircraft  not  appearing  on  the  computer  output  will  be 
assumed  to  have  consumed  no  manhours  during  that  month. 

Data  File.  A  database  for  the  statistical  analysis 
tests  will  be  created  from  the  manhours  calculated  as  de¬ 
scribed  above.  This  data  file  will  contain  the  aircraft 
serial  number ,  and  it's  associated  manhours  for  each  of  the 
six  months  of  data  to  be  analyzed. 

Statistical  Tests 

To  determine  the  sample  size  needed  to  collect  future 
data,  the  historical  data  must  be  analyzed  to  determine  if 
the  mean  and  variance  of  monthly  manhours  per  aircraft  is 
changing  significantly  over  time.  This  analysis  will  also 
determine  the  method  which  should  be  used  to  fix  the  sample 
size.  This  section  describes  the  methodology  that  will  be 
used  to  analyze  the  data. 

Three  types  of  statistical  analysis  tests  will  be  con¬ 
ducted  on  the  database  created  for  this  purpose.  Paired 
difference  tests  will  be  used  to  determine  if  the  mean  dif¬ 
ference  in  manhours  per  aircraft  between  months  is  signifi¬ 
cantly  different  from  zero.  An  analysis  of  variance  test 
will  be  conducted  to  test  all  means  simultaneously  to  deter¬ 
mine  if  at  least  two  of  the  means  are  significantly  differ¬ 
ent.  If  possible,  pairwise  F-tests  will  also  be  performed 
to  determine  if  the  variance  of  manhours  per  aircraft  is 
significantly  different  between  months. 

The  statistical  tests  available  to  analyze  the  data  are 
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each  based  on  a  set  of  assumptions  about  the  relationships 
between  data  elements  and  the  distribution  of  the  population 
to  which  the  data  belong.  Parametric  tests  generally 
require  that  the  data  to  be  compared  come  from  populations 
which  are  normally  distributed,  and  that  the  samples  are 
selected  randomly  and  independently.  Por  the  paired  differ¬ 
ence  test,  the  assumption  of  normality  applies  to  the  rela¬ 
tive  frequency  distribution  of  the  population  of  differences 
between  two  samples.  The  analysis  of  variance  (ANOVA)  test 
requires  the  additional  assumption  that  the  population 
variances  are  equal.  This  implies  that  an  P-test  on  the 
population  variances  must  be  conducted  to  check  this  assump¬ 
tion.  If  the  assumptions  for  the  parametric  tests  cannot  be 
met,  then  a  non-parametric  equivalent  of  the  test  will  be 
used  instead.  Non-parametric  tests  do  not  require  any 
assumptions  about  the  shape  or  variance  of  the  population? 
from  which  samples  are  drawn. 

To  determine  which  tests  to  perform,  histograms  of  the 
raw  data  and  differences  will  be  plotted  to  determine  if  the 
assumptions  of  normality  can  be  met.  If  the  histograms 
appear  to  be  normal  the  parametric  test  will  be  used,  pro¬ 
vided  the  other  assumptions  are  met.  If  the  histograms  do 
not  appear  to  be  normal,  the  non-parametric  test  will  be 
used. 
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Cost  Considerations 


Cost  considerations  normally  have  a  major  impact  on  the 
size  and  type  of  sample  taken,  as  well  as  the  data  collec¬ 
tion  methods  used.  Cost  is  usually  a  budgetary  constraint, 
limiting  the  sample  size  and  dictating  the  logistics  of  data 
collection.  However,  in  this  application  an  attempt  is  be¬ 
ing  made  to  replace  a  census  with  a  sampling  concept.  Sam¬ 
pling  can  only  serve  to  reduce  the  cost  of  data  collection, 
since  less  effort  would  be  involved  in  collecting  and  proc¬ 
essing  the  data. 

A  routine  data  collection  infrastructure  is  already  in 
place  and  operating  at  all  Air  Force  bases.  Certain  fixed 
costs  can  be  associated  with  the  data  collection  effort  in 
terms  of  hardware,  facilities,  and  personnel,  which  are  re¬ 
quired  regardless  of  whether  data  is  collected  by  sampling 
or  census.  Certain  variable  costs  can  also  be  associated 
with  the  physical  collection  and  processing  of  MDC  data, 
such  as  the  cost  of  the  maintenance  technician's  time  to 
enter  data  into  a  computer  terminal,  and  the  cost  of  com¬ 
puter  processing  for  each  MDC  record. 

The  variable  costs  described  above  are  somewhat  artifi¬ 
cial  in  nature  and  might  actually  be  considered  fixed,  de¬ 
pending  on  the  reader's  organizational  perspective.  For 
example,  the  Air  Force  owns  and  operates  it's  own  computers 
and  would  incur  that  operating  cost  in  any  case,  regardless 
of  the  volume  of  data  processed.  From  this  perspective. 
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computer  costs  are  fixed.  On  the  other  hand,  a  charge  may 
be  levied  against  an  organization  for  the  amount  of  computer 
time  actually  used,  and  to  that  organization  the  same  cost 
would  be  variable.  However,  in  reality  that  unit  is  paying 
a  portion  of  fixed  costs  allocated  to  users  on  the  basis  of 
computer  time  used.  Considering  the  nature  of  military  com¬ 
pensation,  the  cost  of  the  maintenance  technician's  time 
will  be  incurred  regardless  of  the  volume  of  data  collected. 
However,  time  not  spent  collecting  and  recording  NDC  data 
might  better  be  applied  to  collecting  improved  reliability 
and  maintainability  data,  or  to  performing  other  tasks. 
Nevertheless,  the  collection  and  processing  of  MDC  data  is 
not  without  cost,  even  if  it  is  only  the  opportunity  cost  of 
using  comouter  time  and  the  maintenance  technician  for  some 
other  purpose.  Therefore,  the  cost  associated  with 
collecting  and  processing  MDC  data  will  be  considered  varia¬ 
ble,  as  described  above,  for  the  purpose  of  identifying 
potential  cost  savings  that  could  be  realized  and  applied  to 
other  uses  as  a  result  of  sampling. 

The  costs  of  collecting  and  processing  MDC  data  are  in¬ 
curred  in  three  stages.  First,  the  actual  cost  of  collect¬ 
ing  and  entering  data  into  the  computer  system  is  incurred 
at  the  base  level.  Included  in  this  category  is  the  cost  of 
transmitting  the  MDC  data  from  base  level  to  AFLC  Headquar¬ 
ters.  The  data  are  then  processed  through  the  D056  Product 
Performance  System,  where  the  second  stage  costs  are  in- 
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curred.  Finally,  the  data  from  the  D056  system  are  provided 
as  input  to  other  Logistics  Command  data  systems  and  are 
sent  to  major  commands.  Air  Force  headquarters,  and  defense 
contractors,  where  the  data  are  again  processed  in  various 
ways. 

Only  the  costs  incurred  in  the  first  two  stages  will  be 
considered  for  analysis  in  this  study.  All  MDC  data  require 
roughly  the  same  collection  and  processing  effort  during  the 
first  two  stages;  therefore,  the  variable  cost  per  record 
can  be  estimated  fairly  easily.  The  third  st«.ge  is  more 
complicated  to  analyze,  because  all  data  is  not  used  and 
processed  in  the  same  manner  by  all  users.  Many  of  these 
third  stage  users  only  process  portions  of  MDC  data  records 
and  perform  various  calculations  and  manipulations  of  the 
data  to  meet  their  individual  needs.  Cost  of  processing 
data  can  be  significant  at  this  level,  depending  on  how  the 
data  are  used.  Identification  of  potential  cost  savings  at 
this  stage  is  beyond  the  scope  of  this  study,  but  should  not 
be  discounted. 

Base  Level.  At  the  base  level,  the  variable  cost  of 
collecting  data  under  the  Automated  Maintenance  System  or 
CAMS  concept,  is  simply  the  labor  cost  of  the  technician's 
time  to  enter  an  MDC  data  record  into  a  computer  terminal. 
The  cost  of  processing  and  transmitting  the  data  is  the 
charge  incurred  by  the  maintenance  organization  for  these 
services. 
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To  estimate  data  collection  costs,  the  time  required  to 
enter  one  data  record  into  the  cosputer  must  be  estimated. 
This  time,  multiplied  by  the  average  base  direct  labor  rate, 
provides  an  estimate  of  the  cost  of  physically  collecting 
and  entering  the  data.  The  average  cost  of  data  processing 
and  transmission  per  record  can  be  determined  by  dividing 
the  charges  for  these  services  during  a  particular  period  by 
the  total  number  of  MDC  records  processed  during  that  same 
period.  Since  the  CAMS  system  has  not  been  in  operation 
long  enough  to  provide  this  data,  the  cost  data  for  the  AMS 
system  will  be  used  as  a  representation  of  the  costs  that 
could  be  expected  with  CAMS.  Not  considered  in  this  study 
are  the  annual  costs  associated  with  keypunch  operations  and 
maintenance  under  the  manual  MDC  system,  which  were  estimat¬ 
ed  in  a  1982  study  sponsored  by  the  Logistics  Management 
Center  at  approximately  $9  million  (6:6-7). 

Logistics  Command  Level.  The  costs  associated  with  the 
processing  of  MDC  data  at  this  level  are  incurred  by  the 
D056  Product  Performance  System,  through  which  all  MDC  data 
are  processed  prior  to  delivery  to  other  users.  The  cost  of 
processing  each  record  can  be  estimated  by  dividing  the  to¬ 
tal  charge  for  computer  time  during  a  specific  period  by  the 
total  number  of  records  processed  during  the  period. 

Total  Variable  Costs.  An  approximate  total  variable 
cost  of  collecting  and  processing  each  MDC  data  record  can 
be  developed  based  on  the  costs  identified  in  the  first  two 
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stages  described  above.  Tnat  cost  can  be  used  to  place  a 
rough  monetary  value  on  the  use  of  sampling  to  collect  MDC 
data.  The  total  number  of  MDC  records  collected  and  proc¬ 
essed  annually  can  be  determined  with  certainty  from  his¬ 
torical  data.  The  total  number  of  records  multiplied  by  the 
average  cost  per  record  provides  an  estimate  of  the  variable 
cost  of  collecting  and  processing  data  by  census.  The  aver¬ 
age  number  of  MDC  records  per  aircraft  at  the  base  level  can 
be  determined  by  dividing  the  total  number  of  records  by  the 
average  number  of  aircraft  assigned  during  the  year.  The 
expected  total  number  of  MDC  records  that  would  be  collected 
and  processed  by  sampling  could  be  approximated  by  multiply¬ 
ing  the  average  number  of  MDC  records  per  aircraft  by  the 
number  of  aircraft  in  the  sample.  The  difference  between 
the  total  number  of  records  by  census  and  the  expected  total 
by  sampling,  multiplied  by  the  cost  per  record,  represents 
the  monetary  value  of  sample  data  collection.  This  analysis 
would  have  to  be  conducted  at  each  base  to  determine  an 
overall  savings  if  sampling  were  used  throughout  the  Air 
Force. 

Impact  On  Other  Users 

The  first  step  in  evaluating  the  use  of  sampling  to 
collect  unscheduled  maintenance  data  is  to  determine  the 
sample  size  that  would  be  required  to  estimate  manhours  with 
a  specified  degree  of  statistical  accuracy.  If  that  analy¬ 
sis  shows  that  sampling  presents  a  significant  cost  savings 
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and  reduction  in  the  data  collection  effort,  the  following 
additional  analysis  will  be  conducted  to  illustrate  the 
impacts  of  sampling  on  users  of  MDC  data.  If  sampling  does 
not  prove  to  be  effective,  the  analysis  will  be  limited  to 
demonstrating  the  use  of  sample  data  in  the  Product  Perfor¬ 
mance  System,  the  VAMOSC  program,  and  LCOM. 

V AMO SC  Program.  The  VAMOSC  program  Component  Sup¬ 
port  Cost  System  (CSCS)  collects  and  totals  on  and  off 
equipment  manhours  at  the  two  digit  and  five  digit  WUC  level 
for  the  computation  of  component  support  costs.  The  CSCS 
system  also  sums  total  repair  actions  at  the  five  digit  WUC 
level  for  action  taken  codes  A,  P,  and  G  for  type  1  and  type 
2  failures.  To  determine  ho*-;  estimated  manhours  and  total 
repair  actions  would  impact  the  CSCS  system,  estimated  fig¬ 
ures  can  be  substituted  into  the  cost  algorithms  to  demon¬ 
strate  the  use  of  sample  data. 

Logistics  Composite  Model  (LCOM) .  In  the  LCOM 
model,  the  action  taken  codes  are  used  to  determine  the 
frequency  with  which  certain  repair  actions  are  required  as 
a  result  of  the  operation  of  the  aircraft  and  the  failure  of 
aircraft  systems.  To  determine  if  the  frequency  of  failure 
and  maintenance  details  collected  by  sampling  would  produce 
the  same  result  as  that  provided  by  a  census,  the  proportion 
of  total  failures  in  the  population  resulting  in  specific 
LCOM  action  codes  can  be  compared  to  the  proportion  of  fail¬ 
ures  in  the  sample  resulting  in  the  same  action  code. 
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Summary 


This  chapter  presents  an  outline  of  the  analysis  to 
follow  in  Chapter  IV  and  places  the  research  in  perspective 
for  the  reader.  The  chapter  provides  the  step  by  step 
research  procedures  to  be  used  to  answer  the  research  ques¬ 
tions  posed  in  chapter  I. 
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IV.  Data  Findings  and  Data  Analysis 


Introduction 

This  chapter  presents  a  step  by  step  description  of  the 
research  that  was  actually  conducted  in  this  thesis  3tudy 
and  presents  an  analysis  of  the  data. 

Preliminary  Analysis 

System  Selection.  The  F-16A  aircraft  was  chosen  as  the 
universe  for  analysis  because  it  has  been  in  the  Air  Force 
inventory  for  several  years  and  the  inventory  is  large.  The 
aircraft  located  at  Hahn  Air  Base  were  chosen  for  study  be¬ 
cause  the  average  aircraft  inventory  at  Hahn  was  fairly  typ¬ 
ical  and  appeared  to  be  relatively  stable  over  time  compared 
to  other  F-16  bases.  Additionally,  Hahn  is  not  routinely 
used  as  a  deployment  site  for  exercises  and  training,  making 
identification  of  the  population  easier.  The  choice  of  Hahn 
AB  was  simply  one  of  convenience  to  limit  the  amount  of  data 
manipulation  required. 

The  Fire  Control  System,  work  unit  code  (WUC)  74XXX, 
was  selected  for  analysis  because  it  appeared  in  the  MODAS 
Reliability  and  Maintainability  Reports  for  April  1985  as 
the  system  with  the  highest  failure  rate  and  second  highest 
manhour  consumption  of  all  systems  on  the  F-16A.  The  choice 
of  this  WUC  guaranteed  availability  of  a  large  data  base 
which  could  be  quickly  accessed  through  the  MODAS  system. 

The  Inertial  Navigation  Subsystem,  WUC  74DXX,  and  the 
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Inertial  Navigation  Unit,  WUC  74DA0,  were  chosen  £or  the 
subsystem  and  component  level  analysis  for  the  same  reasons. 

Population  Identification.  Two  methods  of  determining 
which  aircraft  comprised  the  population  were  actually  used 
during  the  study.  The  first  considered  any  aircraft  which 
generated  any  on  equipment  MDC  records  during  each  month  as 
part  of  the  population.  This  method  produced  a  constant 
list  of  76  aircraft  for  each  month.  An  alternate  method 
considered  any  aircraft  appearing  on  the  Monthly  Aerospace 
Vehicle  Inventory  by  Station  (AVIS)  Report,  produced  by  the 
G033B  system,  as  part  of  the  population.  This  method  pro¬ 
duced  a  population  which  varied  in  size  from  71  to  74  air¬ 
craft.  The  difference  is  attributed  to  the  fact  that  MDC 
data  is  presented  for  an  entire  month  while  the  AVIS  report 
lists  data  as  of  the  last  day  of  the  month. 

Sample  Data  Analysis.  A  random  sample  of  10  aircraft 
was  drawn  for  each  month  out  of  the  population  derived  from 
MDC  data.  On  and  off  equipment  unscheduled  manhours  were 
calculated  and  summed  for  each  of  the  aircraft  at  each  each 
WUC  level  of  detail.  The  mean,  standard  deviation  and  coef¬ 
ficient  of  variation  for  each  month  were  calculated  and  com¬ 
pared  between  WUC  levels  of  detail.  The  result  is  presented 
in  table  III.  The  10  data  points  for  each  of  the  six  months 
were  then  pooled  at  each  level  of  detail  and  the  mean,  stan¬ 
dard  deviation,  and  coefficient  of  variation  were  again  cal¬ 
culated.  The  result  is  presented  in  table  IV.  This  prelim- 
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TABLE  III 


Comparison  of  Monthly  Sample  Data 


NOV 

Dec 

Jan 

Feb 

Mar 

Apr 

System  74XXX 

mean 

8. 54 

14.80 

3.29 

7.76 

17.17 

18.88 

standard  deviation 

7.74 

11.97 

5.59 

9.28 

19.41 

14.97 

coef.  of  variation 

0.91 

0.81 

1.70 

1.20 

1.13 

0.79 

Sub  System  74DXX 

mean 

2.00 

7.63 

0.12 

0.91 

5.21 

6.75 

standard  deviation 

1.30 

9.35 

0.31 

2.02 

6.53 

5.07 

coef.  of  variation 

0.65 

1.22 

2.58 

2.22 

1.25 

0.75 

Component  74DA0 

mean 

0.40 

1.90 

0.00 

0.60 

6.68 

4.18 

standard  deviation 

0.84 

4.54 

0.00 

1.89 

8.65 

5.21 

coef.  of  variation 

2.11 

2.38 

- 

3.15 

1.29 

1.25 

TABLE  IV 

Comparison  of  Pooled  Sample  Data 


Level 

Mean 

Std.  Dev 

Coeff  of  Var 

System 

11.09 

12.60 

1.13 

Sub-System 

3.67 

5.91 

1.611 

Component 

2.29 

5.02 

2.180 
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inary  analysis  indicated  the  variability  of  total  manhours 
per  aircraft  was  greater  at  higher  levels  of  detail.  The 
relative  variability,  as  measured  by  the  coefficient  of  var¬ 
iation,  was  lowest  at  the  system  level;  thus,  WUC  74XXX  was 
chosen  for  further  analysis.  The  preliminary  analysis  also 
indicated  the  mean  and  variance  of  total  manhours  per  air¬ 
craft  might  be  changing  significantly  from  month  to  month. 
This  possibility  has  significant  implications  for  sampling, 
as  the  variability  of  the  data  drives  the  sample  size.  Fur¬ 
ther  detailed  analysis  was  thus  required. 

Population  Data  Analysis 

Manhour  Data  Calculations .  To  eliminate  the  possibili¬ 
ty  of  sampling  error,  a  decision  was  made  to  include  the 
entire  population  data  in  any  further  analysis.  A  computer 
program,  included  in  appendix  A,  was  written  to  calculate 
and  sum  on  and  off  equipment  unscheduled  manhours  separately 
by  aircraft  serial  number  and  month.  A  population  data  base 
was  then  manually  constructed  by  totaling  unscheduled  man¬ 
hours  for  each  aircraft  by  month  using  the  MDC  data  popula¬ 
tion  of  76  aircraft.  Aircraft  which  were  not  listed  on  the 
AVIS  report  were  then  excluded  from  the  population  to  elimi¬ 
nate  any  bias  because  it  was  not  possible  to  determine  ex¬ 
actly  when  these  aircraft  entered  or  exited  the  population. 
Fifteen  aircraft  were  eliminated  in  the  process,  leaving  a 
total  population  of  61  aircraft  for  analysis.  A  computer 
data  file,  containing  the  aircraft  serial  numbers  and  their 
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TABLE  V 


Basic  Manhour  Statistics 


Month 

Mean 

Standard 

Deviation 

Coefficient 
of  Variation 

Smallest 

Value 

Largest 

Value 

Nov 

14.914 

20.112 

1.34851 

0.000 

94.250 

Dec 

16.709 

16.775 

1.00399 

0.040 

96.000 

Jan 

3.906 

7.883 

2.01820 

0.000 

49.830 

Feb 

24.653 

36.097 

1.46418 

0.000 

229.170 

Mar 

30.960 

25.937 

0.83774 

0.080 

105.420 

Apr 

28.952 

28.793 

0.99347 

0.000 

141.420 

Pooled 

20.016 

25.889 

1.29341 

0.000 

229.170 

associated  total  manhours  foe  each  month  of  the  study,  was 
created  and  is  included  in  Appendix  B. 

Histograms  of  Data.  Histograms  of  the  total  manhour 
data  were  plotted  using  a  BMDP5D  statistical  analysis  pro¬ 
gram.  Three  different  types  of  histograms  plotted  were: 

Monthly  total  manhours  per  aircraft  (Appendix  C) . 

Pooled  monthly  total  manhours  per  aircraft  (Appendix  D) . 

Between  month  paired  manhour  differences  (Appendix  E) . 
Analysis  of  the  data  presented  in  the  histograms  indicated 
monthly  unscheduled  manhours  per  aircraft  came  from  a  dis¬ 
tribution  that  appears  exponential.  The  between  month  man¬ 
hour  differences  appeared  normally  distributed. 


Basic  Statistics.  The  mean,  standard  deviation,  coef¬ 


ficient  of  variation,  and  range  for  each  month  and  for  the 
pooled  manhour  data  were  calculated  for  the  population  and 
are  presented  in  Table  V.  The  coefficient  of  variation 
fluctuates  between  months  to  a  larger  degree  than  was  noted 
for  the  random  sample  of  1(9  aircraft.  Further  analysis  of 
the  MDC  dara  was  thus  necessary  to  determine  if  the  change 
in  the  mean  and  variance  was  significant  over  time. 

Statistical  Tests 

Several  standard  statistical  analysis  tests  were  con¬ 
ducted  to  determine  if  the  change  in  mean  and  variance  of 
unscheduled  manhours  per  aircraft  is  significant.  This  sec¬ 
tion  explains  the  tests,  the  reasons  the  tests  were  select¬ 
ed,  and  the  test  results. 

Paired  Difference  T-test.  A  paired  difference  T-test 
was  performed  between  each  set  of  monthly  data  to  test  the 
null  hypothesis 

H0:  Uj.  -  U2  ■  0  (means  are  identical) 
against  the  alternate  hypothesis 

Ha:  -  U2  f  0  (the  means  are  different). 

The  test  is  based  on  the  assumptions  that  the  relative  fre¬ 
quency  distribution  of  the  differences  is  normally  distrib¬ 
uted  and  the  differences  are  randomly  selected  from  the  pop¬ 
ulation  of  differences.  The  individual  monthly  populations 
need  not  be  normally  distributed.  Both  assumptions  were 
met. 
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TABLE  VI 


P  Values  o£  Paired  Difference  Test 


Dec 

Jan 

Peb 

Mar 

Apr 

Nov 

.4972 

.0002 

.0679 

.0004 

.0038 

Dec 

— 

.0000 

.1140 

.0006 

.0042 

Jan 

.0000 

— 

.0001 

.0000 

.0001 

Peb 

.1140 

.0001 

— 

.1954 

.4695 

Mar 

.0006 

.0000 

.1954 

— 

.6346 

The  test  statistic,  t ,  for  the  paired  difference  T-test 
is  calculated  by  the  following  equation: 

X4 

t  *  - 2 - 

*d/nd 

where 

>  mean  of  the  sample  differences 

Sj  ■  standard  deviation  of  the  distribution 
of  differences 

n^  ■  number  of  paired  difference  data 
points 

The  rejection  region  for  this  test  is 

<  ”ta/2  ,n-i  oc  t  >  ^ct/2  ,n-l 

where 

ta/2  n-i  “  critical  valuo  of  the  t  statistic 
'  ’  at  the  a  level  of  significance 

with  degrees  of  freedom. 


The  test  results  in  terms  o£  P-values  are  presented  in 
table  VI.  The  P-value  for  a  specific  statistical  test  is 
defined  as: 

...the  probability  (assuming  Ho  is  true)  of  ob¬ 
serving  a  value  of  the  test  statistic  that  is  at 
least  as  contradictory  to  the  null  hypothesis  and 
is  as  supportive  of  tne  alternate  hypothesis  as 
the  one  computed  from  the  sample  data  (27:295). 

Thus,  the  lower  the  P-value,  the  stronger  the  conclusion 
that  the  means  are  significantly  different.  Analysis  of  the 
data  presented  in  Table  V  shows  that  the  means  of  the  month¬ 
ly  data  are  significantly  different  in  all  but  three  of  the 
fifteen  cases  analysed.  This  result  presents  rather  strong 
evidence  that  the  mean  unscheduled  manhours  per  aircraft  is 
changing  over  time. 

Kruskal-Wallis  Test.  Analysis  of  the  monthly  unsched¬ 
uled  manhours  per  aircraft  histograms  indicated  that  man¬ 
hours  cam*  from  an  exponential,  rather  than  normal  distri¬ 
bution.  Thus,  the  parametric  analysis  of  variance  (ANOVA) 
te3t  was  not  appropriate.  The  non-parametr ic  equivalent  of 
ANOVA,  the  Kruskal-Wallis  H  Test,  which  requires  no  assump¬ 
tions  about  the  3hape  of  the  population  probability  distri¬ 
bution,  was  used  instead.  The  Kruskal-Wallis  test  is  used 
to  test  the  null  hypothesis 

HQ •  All  probability  distributions  are  identical, 
against  the  alternate  hypothesis 

Ha:  At  least  two  of  the  distributions  differ  in 
location. 
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The  test  statistic  used  for  the  Kruskal-Wallis  is 


H 


112/n (n+1) ] 


(Rj2/nj)  -  3 (n+1) 


where 

nj  *  number  of  measurements  in  sample  j 
>-Rj  ®  rank  sum  for  sample  j 
n  *  total  sample  size  -  n^  +  n2  +  . . .  +  n^ 
k  ■  number  of  populations  to  be  compared 


Rj,  the  rank  sum,  is  computed  by  ranking  the  pooled  data 
elements  in  the  total  sample  in  their  relative  order  of 
magnitude. 

The  rejection  region  for  the  Kruskal-Wallis  test  is 
H  > 

where 


k-1  “  the  value  of  the  X*  distribution  at 
the  a  level  of  significance  with 
(k-1)  degrees  of  freedom. 


The  Kruskal-Wallis  test  was  conducted  using  a  BKDP3S 

* 

statistics  program.  The  value  of  the  test  statistic,  H,  was 
computed  as  78.88.  At  five  degrees  of  freedom,  the  P-value 
was  0.0000.  The  result  is  a  very  strong  conclusion  that  at 
least  two  of  the  monthly  populations  differ .  This  supports 
the  conclusions  of  the  paired  difference  t-tests,  that  the 
mean  of  monthly  unscheduled  manhours  per  aircraft  is  chang¬ 
ing  over  time. 

Analysis  of  the  total  unscheduled  monthly  manhours  for 
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the  Fire  Control  System  on  the  F-16AS  at  Hahn  AB  reveals 
that  unscheduled  manhours  for  January  are  significantly  low¬ 
er  than  the  other  five  months.  This  difference  appears  to 
be  peculiar  to  Hahn  AB.  Analysis  of  data  at  the  fleet  level 
and  at  several  other  F-16A  bases  does  not  reflect  the  same 
trend.  Total  operating  hours  at  Hahn  AB  are  relatively  con¬ 
stant  over  the  six  months  studied.  This  raised  a  question 
of  whether  all  January  data  had  been  collected  and  reported, 
or  if  it  had  been  lost.  Therefore,  the  Kruskal-Wallis  test 
was  repeated  without  the  January  data  to  see  if  the  results 
would  be  affected  in  any  way.  The  resulting  H  statistic  was 
23.88,  with  a  P-value  of  0.0881.  The  test  still  provides  a 
strong  conclusion  that  at  least  two  of  the  distributions 
differ  ir.  location,  and  supports  the  evidence  that  the  mean 
manhours  per  aircraft  is  changing  over  time. 

Test  for  Equal  Variance.  The  F-test  to  check  for  a 
significant  difference  in  variance  between  two  samples 
requires  that  both  come  from  populations  which  are  normally 
distributed.  A  review  of  the  histograms  indicates  that  this 
assumption  cannot  be  met  for  the  manhour  data,  thus  the  F- 
test  could  not  be  performed.  Non-par ame trie  tests  for  equal 
dispersion  have  been  developed  based  on  ranking  the  data  and 
using  the  Wilcoxon  rank  statistic  (26:83-113);  however,  none 
of  these  tests  were  contained  in  the  statistical  analysis 
programs  available  to  the  researcher.  Time  did  not  permit 
the  manual  performance  of  these  tests;  therefore,  no  abso- 
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lute  conclusions  can  be  made  concerning  the  variance  of 
unscheduled  manhours  per  aircraft  over  time  as  a  result  of 
this  research. 

Statistical  Test  Conclusions 

The  statistical  tests  were  conducted  to  determine  if 
the  differences  noted  in  the  monthly  mean  and  variance  of 
unscheduled  manhours  were  significant.  The  results  of  the 
statistical  tests  which  could  be  performed  produced  strong 
evidence  that  the  mean  unscheduled  manhours  per  aircraft 
changes  significantly  over  time.  Although  no  test  was 
performed  to  confirm  that  the  change  in  variance  is  also  . 
significant,  a  subjective  review  of  the  standard  deviation 
and  coefficient  of  variation  for  each  month  presented  in 
Table  7.V  shows  a  fairly  wide  range  of  values.  In  all  proba¬ 
bility  the  differences  are  significant;  however,  a  statisti¬ 
cal  test  is  needed  to  confirm  this  assertion.  Nonetheless, 
it  is  safe  to  conclude  that  the  monthly  unscheduled  manhours 
per  aircraft  are  not  identically  distributed. 

Determining  Samcle  Size 

Three  methods  of  determining  sample  size  were  presented 
in  chapter  III.  The  methods  were  proposed  for  use  if  the 
mean  and  variance  of  the  parameter  of  interest  were  known  to 
be  changing  over  time. 

Prediction  Method.  As  discussed  in  Chapter  III,  a 
serial  or  seasonal  time  series  forecasting  model  might  be 
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appropriate  to  predict  the  variability  of  manhours  per  air¬ 
craft  such  that  the  sample  size  is  accurately  fixed  to  meet 
the  precision  requirements.  The  development  of  a  forecast¬ 
ing  model  in  itself  could  be  the  subject  of  another  research 
study.  The  actual  use  of  such  a  technique  in  practice  would 
require  analysis  of  at  least  five  years  of  monthly  histori¬ 
cal  data  to  develop  a  reasonable  degree  of  accuracy.  The 
analysis  would  need  to  be  conducted  for  each  system  on  a 
given  model  aircraft  at  a  given  base,  since  the  sample  size 
would  be  based  on  the  aircraft  system  with  the  highest  vari¬ 
ability  of  manhours  per  aircraft.  This  data  is  not  readily 
available  because  the  MOOAS  system  only  contains  up  to  two 
years  of  monthly  historical  data,  and  because  the  manhour 
data  is  not  compiled  or  tracked  by  aircraft  serial  number. 
Therefore,  a  computer  program  such  as  the  one  used  in  this 
study,  would  need  to  be  run  against  at  least  five  years  of 
historical  data  to  compute  manhours  by  serial  number. 

In  the  absence  of  the  required  data  and  considering  the 
level  of  effort  that  would  be  required  to  develop  a  fore¬ 
casting  technique,  if  one  can  be  developed,  the  best 
approach  that  can  be  used  is  to  determine  the  sample  size  by 
either  the  worst  case  or  average  case  methods  discussed  in 
Chapter  III. 

Worst  Case  Method.  Using  this  method,  the  sample  size 
is  based  on  the  system  with  the  highest  variability  in  man¬ 
hours  per  aircraft  during  a  previous  time  period.  Of  the 
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Variability  and  Sample  Size 


Month 

Coefficient 
of  Variation 

Sample 

Size 

Nov 

1.34851 

65 

Dec 

1.00399 

58 

Jan 

2.01820 

70 

Feb 

1.46418 

66 

Mar 

0.83774 

53 

Apr 

0.99347 

58 

Pooled 

1.29341 

64 

six  months  oC  data  analyzed  Cor  the  Fire  Control  System,  the 
highest  coefficient  of  variation  was  experienced  during  the 
month  of  January,  as  indicated  in  Table  VII.  The  sample 
size  required  each  month  for  future  da  .  collection  would  be 
70  aircraft  based  on  an  average  population  of  74.  This  fig¬ 
ure  was  determined  using  equation  (1): 

N  l(Z)(C)]2  (74)  [  (1.64)  (2.01820) ] 2 

Nd2  ♦  [ZC]2  (74)  (.10)2  +  [  (1 . 64)  (2. 0182) ] 2 

n  ■  69.31  •  70  aircraft 
where 

N  ■  population  size 

Z  ■  1.64  *  Normal  table  Z  value  for  90%  confidence 
C  *  Coefficient  of  Variation  »  std  dev/mean 
d  *  .10  ■  10%  relative  precision 
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TABLE  VIII 


Sample  Size  and  Precision 


Level  Sample  Size  vs. 


of 

Confidence 

Relative  Accuracy 
103  15%  20% 

90 

64 

54 

45 

85 

61 

50 

40 

80 

58 

46 

36 

Even  if  the  January  data  were  suspect,  as  previously  dis¬ 
cussed,  a  similar  result  is  obtained  using  the  next  highest 
coefficient  of  variation  which  occurred  in  February.  The 
resulting  sample  size  would  be  66  out  of  74  aircraft.  In 
both  cases  the  result  is  almost  a  census. 

Average  Case  Method.  Using  this  method,  the  data  for 
all  six  months  are  pooled  and  a  coefficient  of  variation  is 
calculated.  The  sample  size  required  using  this  technique 
would  be  64  out  of  74  aircraft;  less  than  that  determined  by 
the  worst  case  method,  but  not  significantly  lower. 

Sample  Size  and  Precision.  In  addition  to  the  varia¬ 
bility  of  manhours,  the  level  of  confidence  and  the  degree 
of  statistical  precision  desired  of  the  estimates  have  an 
impact  on  the  sample  size.  Table  VIII  presents  the  sample 
size  required  for  three  levels  of  confidence  and  three  de¬ 
grees  of  relative  precision  based  on  the  average  case  metn- 
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od.  For  each  five  percent  of  accuracy  reduction,  the  sample 
size  is  reduced  by  10  aircraft.  For  each  five  percent  re¬ 
duction  in  the  level  of  confidence,  the  sample  size  is  re¬ 
duced  from  three  to  five  aircraft  depending  on  the  relative 
precision.  In  general,  the  lower  the  relative  precision  and 
level  of  confidence  needed  in  the  parameter  to  be  estimated, 
the  lower  the  required  sample  size.  Thus,  if  management  can 
accept  a  lower  degree  of  statistical  precision  than  the  10 
percent  relative  precision  and  90  percent  level  of  confi¬ 
dence  used  in  this  study,  a  smaller  sample  may  be  used. 

Cost  of  MDC  Data  Collection 

A  methodology  for  estimating  the  approximate  variable 
cost  of  collecting  and  processing  MDC  data  was  developed  in 
Chapter  III.  The  following  cost  function  is  based  on  using 
an  automated  maintenance  system  concept: 

VC  »  (T)  x  (L)  +  BPT  +  LP  (2) 

where 

VC  ■  total  variable  cost  of  collecting  and  processing  one 
MDC  record 

T  ■  average  time  to  enter  an  MDC  data  record  into  a 
computer  terminal 

L  ■  average  maintenance  technician  labor  rate  per  minute 
BPT  *  base  computer  processing  and  transmission  cost 
LP  -  AFLC  computer  processing  cost 

Time  to  Enter  Data.  The  average  time  required  to  enter 
MDC  data  into  an  automated  system  computer  terminal  was  es¬ 
timated  from  experience  with  the  AMS  at  Dover  AFB.  The  MAC 
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Management  Engineering  Team  (MACMET)  was  in  the  ccess  of. 
developing  a  new  LCOM  simulation  model  for  Dover  and  provid¬ 
ed  a  time  estimate  for  data  entry.  The  distribution  oir  time 
required  to  enter  KDC  data  into  the  computer  termi’',\s  at 
Dover  averages  one  minute  with  a  range  of  thirty  secu  ids  co 
four  minutes.  The  actual  time  required  in  a  given  r.nstance 
would  depend  on  the  availability  of  a  computer  terminal , 
machine  response  time,  number  of  mistakes  in  data  entry,  and 
the  proficiency  of  the  technician. 

Average  Technician  Labor  Rate.  The  base  maintenance 
direct  labor  rate  varies  substantially  from  one  location  to 
another.  Manpower  authorizations  and  grade  structure  of  the 
maintenance  organizations  also  vary  between  weapon  systems 
due  to  differences  in  technical  complexity,  system  reliabil¬ 
ity,  and  other  factors.  To  address  labor  cost  without  con¬ 
sidering  these  variances,  the  assumption  was  made  that  main¬ 
tenance  organizations  are  composed  primarily  of  military 
personnel  with  an  overall  grade  structure  similar  to  the  to¬ 
tal  Air  Force  grade  structure.  A  weighted  average  techni¬ 
cian  labor  rate  for  a  maintenance  organization,  presented  in 
Table  IX,  was  developed  from  the  current  Hourly  Composite 
Standard  Rates  for  Military  Personnel  by  Grade  and  the  Sep¬ 
tember  1984  USAF  Total  Active  Duty  Strength  by  Grade  statis¬ 
tics  ((10:270-272;  31:189).  The  rate  calculated  by  th*s 
method  was  $12  per  hour  or  20  cents  per  minute.  Since  the 


TABLE  IX 


Weighted  Average  Maintenance  Technician  Labor  Cost 


Grade 

Total 

Force 

Proportion 
of  Total 

AFR  177-101 
Hourly  Rate 

Weighted 

Average 

E-9 

4,842 

0.00995 

24.64 

.2450 

E-8 

9,963 

0.01986 

20.76 

.4125 

E-7 

36,519 

0.07508 

17.86 

1.3409 

E-6 

56,261 

0.11566 

15.23 

1.7615 

E-5 

108,859 

0.22380 

12.74 

2.8512 

E-4 

102,758 

0.21125 

10.94 

2.3111 

E-3 

124,652 

0.25626 

9.33 

2.3909 

E-2 

22,021 

0.04527 

8.49 

0.3843 

E-l 

20,835 

0.04283 

7.25 

0.3465 

Total 

486,410 

1.000 

$12.0079 

average  time  required  to  enter  one  MDC  data  record  into  a 
computer  terminal  is  one  minuter  the  technician  cost  of  this 
transaction  is  estimated  at  20  cents. 

Base  Level  Processing  and  Transmission.  Cost  of  base 
level  processing  and  transmission  of  MDC  data  were  estimated 
from  costs  associated  with  the  C-5A  at  Dover,  Travis,  and 
Altus  AFBs .  Cost  of  MDC  data  processing  and  transmission 
for  the  C-5  are  tracked  by  HQ/MAC  LGX.  The  most  recent  data 
available  showed  that  the  MAC  Industrial  Fund  for  the  C-5 
entered  689,000  transactions  and  was  charged  $12,485  by 
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TABLE  X 


0056  Data  Processing  Costs 


Month 

Machine 

Hours 

MDC  Records 
Processed 

Mov 

164.5 

2,228,997 

Dec 

201.1 

1,826,667 

Jan 

129.5 

1,710,095 

Feb 

195.0 

1,739,172 

Mar 

218.75 

2,386,405 

Apr 

109.5 

1,929,925 

Total 

1018.35 

11,821,261 

Tinker  Data  Services  £or  teleprocessing,  or  $0,018  per 
transaction  (9) .  These  costs  are  representative  of  those 
which  could  be  expected  for  processing  and  transmitting  base 
level  data  using  an  automated  system  concept. 

AFLC  Processing  Costs.  All  MDC  data  is  processed 
through  the  D056  Product  Performance  System  at  AFLC  Head¬ 
quarters.  The  D056  system  is  composed  of  five  different 
subsystems,  each  of  which  is  assessed  a  charge  for  computer 
machine  time.  Although  every  MDC  record  is  not  processed 
through  all  five  systems,  it  was  not  possible  to  determine 
how  many  records  were  processed  by  each  individual  system. 

A  total  MDC  record  count  was  readily  available  for  the  D056A 
system,  which  does  process  every  record.  Average  per  record 


87 


cost  of  D056  data  processing  was  estimated  by  summing  all 
D056  machine  time  over  a  six  month  period,  multiplying  by 
the  hourly  rate,  and  dividing  the  result  by  the  total  number 
of  records  processed  through  D056A  during  the  same  period. 
Machine  time  was  provided  by  AFLC/AD  and  total  record  counts 
were  provided  by  AFLC/MME-2  and  are  shown  in  table  X  (23) . 
Machine  hours  are  charged  at  a  rate  of  $144  per  hour;  thus, 
the  cost  of  processing  each  MDC  record  by  the  0056  system 
using  this  method  was  calculated  at  $0.0124  per  record. 

Total  Variable  Cost.  The  per  record  variable  cost  of 
collecting  and  processing  MOC  records  estimated  using  equa¬ 
tion  (2)  is: 

VC  -  ( <T)  x  (L)]  +  BPT  ♦  LP 

«  ((1  min.)  x  ($.20/min.) ]  ♦  $0,018  +  $0.0124 
■  $0.2304  per  record 

Using  this  function,  the  total  variable  cost  of  collecting 
and  processing  approximately  23  million  MDC  records  produced 
annually  is  estimated  at  $5.3  million  per  year. 

Potential  Cost  Savings 

Based  on  the  sample  size  requirements  using  the  worst 
case  and  average  case  methods,  the  cost  savings  that  would 
result  from  sampling  are  rather  small.  The  total  number  of 
MDC  records  collected  at  Hahn  AB  during  the  last  year  was 
43,494  of  which  29,065  records  (67%)  were  unscheduled  type 
"A”  and  "H"  records,  for  an  average  of  393  unscheduled 
records  per  aircraft.  Savings  at  Hahn,  using  the  worst  case 
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method,  would  be  4  aircraft,  1568  records,  and  $361.  Using 
the  average  case  method,  the  savings  would  be  10  aircraft, 
3930  records,  and  $905. 

It  would  be  impossible  to  extrapolate  the  potential 
cost  reduction  from  sampling  described  above  to  estimate 
potential  savings  throughout  the  Air  Force.  The  analysis 
was  conducted  on  only  one  system  at  one  base,  and  merely 
illustrates  a  methodology  that  can  be  used  to  make  such  an 
estimate.  Other  systems  may  exhibit  even  greater  variabili¬ 
ty  in  manhours  per  aircraft,  requiring  an  even  larger  sample 
size,  with  the  extreme  being  a  complete  census.  The  sample 
size  could  also  be  different  for  different  aircraft,  differ¬ 
ent  bases  and  different  population  sizes;  thus,  cost  savings 
would  be  different  at  each  base. 

Impact  on  Other  Data  Systems. 

The  sample  size  required  to  collect  MDC  data  based  on 
the  precision  requirements  was  quite  large  and  cost  savings 
as  a  result  of  sample  data  collection  would  probably  be 
quite  small.  Since  implementation  of  a  sampling  concept  to 
collect  MDC  data  would  be  doubtful ,  a  detailed  analysis  of 
actual  data  provided  by  the  serial  number  sampling  plan  was 
not  conducted.  However,  based  on  the  methodology  of  the 
sampling  scheme,  the  following  observations  can  be  made. 

Logistics  Composite  Modeling.  The  inputs  for  the  LCOM 
model  derived  from  the  MDC  data  are  the  relative  frequency 
distributions  of  failures,  actic.is  taken,  type  failure,  type 
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maintenance;,  and  the  like.  Absolute  total  figures  are  not 
needed.  Exactly  the  same  type  of  census  MDC  data  would  be 
collected  using  the  serial  number  sampling  approach,  but 
only  on  a  sample  of  aircraft.  Therefore,  the  same  type  of 
information  would  be  available  for  LOOM. 

Manhour  inputs  for  LCOM  are  developed  from  sources 
other  than  MDC  data.  The  use  of  MDC  data  for  LCOM  would 
therefore  not  be  affected  by  the  fact  that  sampling  is  based 
on  manhours  per  aircraft.  The  only  impact  that  serial  num¬ 
ber  sampling  would  have  on  developing  an  LCOM  simulation 
data  base  is  that  it  might  be  necessary  to  use  historical 
data  collected  over  a  longer  period  of  time  than  is  needed 
with  a  census. 

VAMOSC .  The  Visibility  and  Management  of  Operating  and 
Support  Costs  is  essentially  a  cost  collection  system  rather 
than  an  accounting  or  cost  estimating  system.  Sample  data 
would  change  the  VAMOSC  program  to  a  cost  estimating  system. 
The  impact  on  the  WSSC  and  CSCS  systems  of  VAMOSC  will  be 
discussed  in  the  following  two  sections. 

The  Weapon  System  Support  Cost  System  (WSSC) .  The 
WSSC  system  of  VAMOSC  uses  MDC  manhour  data  to  allocate  be¬ 
low  depot  maintenance  costs  at  the  base  level  by  aircraft 
mission-design-series  (MDS) .  At  bases  where  several  differ¬ 
ent  MDS  aircraft  are  collocated,  the  cost  of  using  mainten¬ 
ance  resources  are  allocated  to  each  MDS  by  the  proportion 
of  manhours  used.  With  serial  number  sampling  this  alloca- 
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tion  would  be  based  on  estimated  total  manhours  rather  than 
actual  total  manhours. 

Component  Support  Cost  System  (CSCS)  .  The  CSCS 
system  of  VAMOSC  uses  MDC  manhour  data  and  actions  taken 
data.  Manhours  are  summed  by  like  work  unit  code  (WUC) , 
base  and  MDS  and  multiplied  by  the  base  direct  labor  rate  to 
calculate  the  base  labor  costs  by  MDS.  Using  serial  number 
sampling  the  base  labor  costs  would  be  estimated ,  with  the 
same  degree  of  statistical  precision  associated  with  the 
manhour  estimate.  Actions  taken  codes  are  summed  at  the  two 
digit  and  five  digit  WUC  levels  to  calculate  the  total  num¬ 
ber  of  repair  actions  at  various  levels  of  detail.  This 
figure  is  used  to  calculate  the  base  direct  material  costs 
by  WUC  and  MDS.  Total  repair  actions  could  be  estimated 
from  the  sample  data  by  multiplying  the  average  number  of 
repair  actions  per  aircraft  by  the  total  number  of  aircraft 
at  the  base.  This  estimate  would  have  a  known  degree  of 
statistical  precision,  although  it  would  not  necessarily  be 
the  same  as  the  precision  associated  with  the  manhour  esti¬ 
mate. 

Product  Performance  System  (D056) .  The  D056  system 
processes  all  MDC  data  records  collected  at  base  and  depot 
levels.  With  the  use  of  serial  number  sampling,  the  data 
collection  and  processing  methodology  is  virtually  un¬ 
changed;  thus,  the  impact  on  the  D056  system  would  be  mini¬ 
mal.  The  volume  of  data  processed  would  be  reduced,  which 
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could  improve  the  timeliness  of  the  data  system  to  users. 
Some  additional  programming  would  be  required  to  calculate 
the  statistics  associated  with  the  sample  data  and  the  popu¬ 
lation  summary  estimates. 

Conclusion 

There  were  a  number  of  major  findings  as  a  result  of 
the  analysis  of  the  HOC  manhour  data  for  the  P-16  Pire  Con¬ 
trol  System  at  Hahn  AB.  Monthly  unscheduled  manhours  per 
aircraft  were  found  to  have  large  variability,  requiring  a 
rather  large  sample  size  to  estimate  the  total  unscheduled 
maintenance  manhours  at  the  two  digit  WUC  (system)  level 
with  10  percent  relative  precision  and  90  percent  confi¬ 
dence.  The  total  variable  cost  of  collecting  and  processing 
MDC  data  at  base  level  and  at  APLC  headquarters  was  found  to 
be  significant.  However,  because  of  the  large  sample  size 
requirement  based  on  the  variability  of  historical  data,  it 
appears  that  the  potential  cost  savings  as  a  result  of 
sampling  by  aircraft  serial  number  are  small. 


Vo  Summary,  Results ,  Conclusions ,  and  Recommendations 


Overview 

This  chapter  summarizes  the  research  e££ort,  presents 
results  in  terms  o£  the  research  questions,  draws  conclu¬ 
sions,  and  offers  recommendations  for  further  research. 

Summary 

This  study  explored  the  feasibility  of  using  statisti¬ 
cal  sampling  techniques  to  collect  the  Air  Force  maintenance 
data  currently  collected  by  census  in  the  MDC  system.  Sam¬ 
pling  is  explored  determine  if  the  volume  of  MDC  data  col¬ 
lected  could  be  reduced  and  still  provide  management  with 
the  type  of  data  currently  available  from  the  MDC  system. 

If  sampling  is  sufficient  to  provide  management  with  this 
data,  the  effort  and  cost  of  collecting  and  processing  KDC 
data  could  be  reduced.  The  study  does  not  address  the  ques¬ 
tion  of  whether  management  truly  needs  or  uses  the  type  of 
data  currently  provided  by  the  MDC  system.  The  assumption 
was  made  that  the  data  are  needed  and  used,  although  the 
assertion  has  been  made  time  and  again  that  they  are  not. 

Tht  focus  of  the  study  is  twofold.  First  a  practical 
sampling  methodology  i3  identified  and  the  resulting  sample 
size  that  would  be  required  to  collect  data  with  a  specified 
degree  of  statistical  precision  is  illustrated.  Then  the 
variable  cost  of  MDC  data  collection  and  processing  is  iden¬ 
tified.  Based  on  the  required  sample  size  and  the  cost  of 
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data  collection  the  potential  cost  and  effort  savings  re- 
suiting  from  sampling  are  evaluated. 

The  sampling  methodology  developed  is  based  on  a  sim¬ 
ple  random  sample  of  aircraft,  by  serial  number,  with  census 
data  collected  on  all  aircraft  in  the  sample.  To  estimate 
the  required  sample  size,  the  sampling  plan  is  designed  to 
estimate  the  base  level  monthly  total  unscheduled  mainten¬ 
ance  manhours  at  the  two  digit  work  unit  code  (system) 
level.  The  methodology  used  to  estimate  the  variable  cost 
of  collecting  and  processing  MDC  data  records  is  limited  to 
base  and  Air  Force  Logistics  Command  (AFLC)  levels.  Base 
level  costs  considered  are  the  opportunity  cost  of  a  main¬ 
tenance  technician's  time  to  enter  one  MDC  record  into  an 
automated  system  terminal  and  the  cost  of  computet:  process¬ 
ing  and  transmission  of  data  to  AFLC.  AFLC  costs  considered 
are  the  machine  time  charges  assessed  against  the  D056  Prod¬ 
uct  Performance  System. 

Results 

The  following  results  are  presented  in  relation  to  the 
research  questions  that  guided  the  study. 

Research  Question  1.,  What  sampling  plan(s)  can  be  best 
be  applied  to  the  collection  of  aircraft  failure  and  main¬ 
tenance  manhour  data  to  provide  the  same  type  of  information 
that  is  currently  provided  to  users  of  the  MDC  data? 

Two  possible  sampling  plans  which  could  be  used  to  col¬ 
lect  MDC  data  are  identified:  sampling  by  job  control  num- 
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bet  and  sampling  by  aircraft  serial  number.  Job  control 
number  sampling  involves  collecting  MDC  data  on  a  random 
sample  of  maintenance  jobs  and  then  estimating  total 
unscheduled  maintenance  manhours  from  the  mean  manhours  per 
maintenance  job.  This  sampling  methodology  was  previously 
evaluated  by  the  Air  Force  Logistics  Management  Center  and 
found  to  be  administratively  infeasible;  therefore,  it  was 
not  studied  further.  Serial  number  sampling  involves  col¬ 
lecting  census  MDC  data  on  a  random  sample  of  individual 
aircraft  and  then  estimating  total  unscheduled  manhours  from 
the  mean  manhours  per  aircraft.  Collection  of  census  data 
on  a  sample  of  aircraft  closely  resembles  the  current  MDC 
system  and  could  thus  be  implemented  without  any  major 
changes  in  the  existing  data  collection  infrastructure. 
Sampling  by  aircraft  serial  number  is  therefore  considered 
to  be  the  sampling  plan  which  could  best  provide  the  same 
type  of  information  that  is  currently  available  to  users  of 
the  MDC  data. 

Research  Question  2,  What  degree  of  statistical  preci¬ 
sion  can  be  obtained  by  sampling  and  how  large  must  the  sam¬ 
ple  size  be? 

Based  on  the  average  variability  of  manhours  per  air¬ 
craft  of  one  system  on  the  F-16A  aircraft  at  Hahn  AB,  86 
percent  of  the  base  aircraft  population  would  need  to  be 
sampled  to  estimate  base  monthly  total  unscheduled  mainten¬ 
ance  manhours  with  10  percent  relative  precision  and  90  per- 
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cent  confidence.  If  the  relative  precision  requirement  is 
reduced  to  20  percent,  only  61  percent  of  the  aircraft  popu¬ 
lation  would  need  to  be  sampled.  If  the  confidence  level  is 
also  reduced  to  80  percent,  then  only  49  percent  of  the  air¬ 
craft  population  would  need  to  be  sampled. 

,  Research  Question  3.-  How  can  the  sample  data  be  used 
and  related  to  the  entire  population  to  obtain  information 
such  as  Maintenance  Manhours  per  Plying  Hour  (MM/PH)  and 
Mean  Time  Between  Maintenance  (MTBM) ? 

MDC  data  provided  by  serial  number  sampling  produces 
little  change  over  the  current  use  of  census  MDC  data.  Sam¬ 
ple  MM/FH  and  MTBM  can  be  calculated  in  exactly  the  same 
manner  as  currently  determined  for  the  population,  by  simply 
using  the  manhours,  failure  counts  and  operating  hours  of 
those  aircraft  in  the  monthly  sample. 

Relating  sample  data  to  the  population  requires  a 
slightly  different  approach.  Population  MH/FH  is  estimated 
by  simply  multiplying  the  sample  mean  monthly  manhours  per 
aircraft  by  the  number  of  aircraft  in  the  base  population 
and  dividing  the  result  by  the  total  base  population  operat¬ 
ing  hours.  Likewise,  population  MTBM  can  be  estimated  by 
dividing  the  total  population  operating  hours  by  the  mean 
failures  per  aircraft  multiplied  by  the  total  number  of 
aircraft  in  the  base  population.  In  this  study,  failure 
counts  were  assumed  to  be  collected  by  census,  since  all 
failures  need  to  be  reported  before  maintenance  can  be 
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Ifierformed.  However,  MTBM  could  conceivably  be  estimated  as 
Prescribed. 

|  It  should  be  noted  that  population  manhours  cannot  be 
f estimated  by  multiplying  the  sample  MM/FH  by  the  total  oper¬ 
ating  hours,  nor  can  failure  counts  be  estimated  by  dividing 
total  operating  hours  by  the  sample  MTBM  because  manhours, 
failure  counts,  and  operating  hours  are  all  random  varia¬ 
bles.  Estimation  of  the  population  manhours  and  failure 
counts  in  this  manner  would  be  a  ratio  estimate.  This  re¬ 
quires  that  the  exact  mathematical  relationships  between 
manhours  and  operating  hours  and  failures  and  operating 
hours  are  known.  The  exact  mathematical  relationships  are 
not  known. 

Research  Question  4^  Will  sampling  provide  significant 
cost  savings  over  the  current  census  data  collection  meth¬ 


ods? 


The  total  per  record  variable  cost  of  collecting  and 


processing  MDC  data  using  an  automated  system  approach  at 
the  base  and  AFLC  Product  Performance  System  levels  is  esti¬ 
mated  at  $0.23.  Thus,  the  total  variable  cost  of  collecting 
and  processing  approximately  23  million  MDC  records  annually 
is  estimated  at  $5.3  million. 

The  sample  size  required  to  estimate  base  level  monthly 
unscheduled  maintenance  manhours  at  the  two  digit  work  unit 
code  level,  with  10  percent  relative  precision  and  90  per¬ 
cent  confidence  would  be  quite  large;  in  many  cases 
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approaching  a  census.  Annual  cost  savings  at  Hahn  AB,  using 
the  sample  size  of  70  out  of  74  aircraft  for  the  worst  case 
variability,  and  64  out  of  74  aircraft  for  the  average  vari¬ 
ability,  would  amount  to  approximately  $300  and  $900  respec¬ 
tively.  Based  on  this  limited  study  it  would  be  impossible 
to  project  a  total  cost  savings  for  the  Air  Force  resulting 
from  sampling;  however,  the  total  savings  would  probably  be 
small.  If  a  forecasting  method  can  be  developed  to  accu¬ 
rately  predict  the  manhour  variability  in  advance,  it  might 
be  possible  to  fix  the  sample  size  more  accurately  to  meet 
the  minimum  precision  requirements.  This  might  reduce  the 
sample  size  requirement  and  could  result  in  a  larger  cost 
savings  through  sampling. 

Research  Question  5^  What  is  the  impact  of  the  use  of 
sample  data  on  LCOM,  VAMOSC,  and  the  Product  Performance 
System? 

This  research  indicated  that  the  sample  size  required 
to  collect  MDC  data  was  so  large,  because  of  the  variability 
in  manhours,  that  implementation  of  a  sampling  concept  would 
be  doubtful.  Therefore,  a  detailed  analysis  of  the  MDC  data 
that  would  be  provided  by  sampling  was  not  conducted.  Thus, 
research  question  five  cannot  be  answered  definitively;  how¬ 
ever,  the  following  observations  can  be  made. 

LCOM.  The  design  of  the  aircraft  serial  number 
sampling  methodology  should  be  sufficient  to  satisfy  the  r 
requirements  for  LCOM.  The  only  impact  that  serial  number 


sampling  would  have  on  developing  an  LCOM  simulation  data 
base  is  that  instead  of  using  only  the  latest  six  months  to 
one  year  of  base  level  MDC  data,  it  might  be  necessary  to 
use  data  collected  over  a  longer  period  of  time. 

VAMPS C .  The  Visibility  and  Management  of  Operat¬ 
ing  and  Support  Cost  Program  is  essentially  a  cost  collec¬ 
tion  system  rather  than  an  accounting  or  cost  estimating 
system.  The  use  of  sample  data  would  effectively  change  the 
V AMO SC  program  from  a  cost  collection  to  a  cost  estimating 
system,  with  estimates  having  a  known  degree  of  statistical 
precision. 

Product  Performance  System  (PQ56) .  The  D056 
system  processes  all  MDC  data  collected  at  base  and  depot 
levels.  With  the  proposed  method  of  sampling  by  aircraft 
serial  number,  the  actual  data  collected  would  remain 
unchanged;  only  the  volume  would  be  reduced.  However,  some 
additional  programming  would  be  required  to  calculate  the 
statistical  precision  of  the  sample  data  and  to  estimate  the 
population  summary  figures  now  developed  from  the  census 
data. 

Research  Question  £.  How  can  sampling  be  practically 
administered  and  controlled  in  the  field? 

The  implementation  of  the  CAMS  system  offers  some 
unique  opportunities  for  the  use  of  automated  routines  to 
insure  that  sample  data  are  collected  on  the  right  aircraft, 
at  the  right  time,  and  in  the  correct  format.  Theoretical- 
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ly,  computer  routines  could  be  used  to  direct  the  entire 
sample  data  collection  effort.  As  with  any  data  system, 
controlling  the  data  collection  to  prevent  bias  presents  a 
problem.  Undetected  bias  could  have  a  greater  impact  on  the 
estimates  made  from  sample  data  than  it  would  on  the  actual 
results  using  census  data;  however,  because  of  the  reduced 
volume  of  data  collected  and  processed  more  effort  can  be 
directed  toward  insuring  that  only  accurate  data  is  collect¬ 
ed. 

Conclusions 

The  objective  of  this  research  effort  wa3  to  determine 
whether  statistical  sampling  is  a  practical  and  feasible 
method  of  reducing  the  volume  and  cost  of  MDC  data  collect¬ 
ion  without  losing  any  valuable  information.  The  objective 
has  been  met  with  mixed  results. 

The  conclusion  reached  as  a  result  of  this  study  is 
that  sampling  by  aircraft  serial  number  is  a  practical  meth¬ 
od  of  collecting  MDC  data.  The  method  is  simple;  requires 
little  change  in  the  way  data  are  collected,  processed,  and 
used;  and  would  be  relatively  easy  to  implement.  However, 
in  the  absence  of  a  forecasting  technique  to  predict  the 
variability  of  monthly  unscheduled  maintenance  manhours  per 
aircraft,  the  use  of  sampling  appears  to  be  infeasible.  The 
sample  size  required  to  estimate  base  total  monthly  unsched¬ 
uled  manhours  with  an  acceptable  degree  of  statistical  pre¬ 
cision,  based  on  the  greatest  or  average  variability  of  the 

historical  data,  is  nearly  the  same  as  a  census. 
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Statistical  sampling  by  aircraft  serial  number,  as 
presented  in  this  study,  does  not  appear  to  be  a  viable 
alternative  to  a  census  given  the  current  data  structure  of 
the  MDC  system  and  the  assumption  that  manhour  data  is 
needed  and  can  only  be  collected  through  the  MDC  system. 

Any  cost  savings  resulting  from  statistical  sampling  are 
insignificant,  unless  a  forecasting  technique  to  predict 
future  variability  can  be  used  to  lower  the  sample  size 
requirement. 

Recommendations  For  Further  Research 

Based  on  the  research  results,  no  further  research  is 
recommended  on  the  use  of  statistical  sampling  to  collect 
MDC  data,  as  the  system  is  currently  structured.  However, 
two  additional  areas  do  offer  some  potential  for  further 
study  and  analysis. 

Sampling  Concept.  The  0.  S.  Army  Unscheduled  Mainten¬ 
ance  Sample  Data  Collection  (UMSDC)  System  uses  a  different 
sampling  concept  than  proposed  in  this  study.  Selection  of 
the  bases  for  data  collection  is  not  random,  but  made  on  the 
basis  of  other  considerations.  The  Army  sampling  concept  is 
not  statistical  sampling  and  thus  the  data  collected  may  or 
may  not  be  representative  of  all  aircraft. 

This  research  study  avoided  the  use  of  non-statistical 
sampling  concepts,  such  as  that  used  by  the  Army,  for  sever¬ 
al  reasons: 
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1.  AicccaCt  of  the  same  model  are  located  in  many  dif¬ 
ferent  environments,  and  it  is  believed  that  failure  pat¬ 
terns  and  maintenance  requirements  differ  significantly  by 
location. 

2.  Maintenance  organizations,  policies,  and  philoso¬ 
phies  are  believed  to  be  different  between  bases  and  between 
commands;  thus,  the  quality  and  type  of  maintenance  and  the 
resulting  performance  of  the  aircraft  may  differ  signifi¬ 
cantly  by  location. 

3.  Aircraft  of  the  same  model  may  be  used  for  differ¬ 
ent  missions  at  different  locations.  Mission  profiles  and 
use  of  tne  aircraft  may  thus  be  different,  and  it  is  believ¬ 
ed  that  failure  patterns  and  maintenance  requirements  would 
differ  by  location. 

As  a  follow  on  to  this  study,  interested  researchers 
could  investigate  the  failure  patterns  and  maintenance 
requirements  of  the  same  model  aircraft  at  different  loca¬ 
tions  to  determine  if  in  fact  there  are  statistically  sig¬ 
nificant  differences  between  locations,  commands,  and  mis¬ 
sion  profiles.  If  no  differences  are  found,  then  a  sampling 
concept  similar  to  that  used  by  the  Army  might  be  considered 
for  use  by  the  Air  Force. 

Use  of  MDC  Data.  Manhours  per  flying  hour  (MM/FH)  is 
one  of  the  main  parameters  of  interest  derived  from  MDC 
data.  However,  MM/FH  could  not  be  estimated  directly  by 
sampling  because  a  known  direct  relationship  between  main- 


tenance  manhours  and  flying  hours  does  not  exist.  For  exam¬ 
ple,  total  unscheduled  manhours  for  the  population  cannot  be 
estimated  by  multiplying  the  sample  MM/FH  by  the  total  num¬ 
ber  of  hours  flown,  because  manhours  is  a  function  of  sever¬ 
al  parameters,  only  one  of  which  is  flying  hours. 

For  this  reason  unscheduled  manhours  per  aircraft  was 
chosen  the  parameter  on  which  to  base  estimates  of  the  total 
population  manhours.  When  manhours  per  aircraft  were  plot¬ 
ted  on  a  histogram,  the  resulting  distribution  appeared  to 
be  exponential  in  nature.  Considering  the  lack  of  an  appar¬ 
ent  direct  relationship  between  manhours  and  flying  hours, 
and  an  apparent  recognizable  distribution  of  manhours  per 
aircraft,  research  in  the  following  areas  is  recommended: 

1.  Investigate  the  relationship  between  manhours  and 
flying  hours.  The  use  of  the  HH/FH  statistic  implies  that  a 
direct  relationship  between  these  parameters  exists  and  that 
future  manhours  consumed  can  be  predicted  if  one  knows  the 
past  MH/FH  and  the  expected  number  of  hours  to  be  flown  in 
the  future.  It  also  implies  that  different  aircraft  models 
can  be  compared  on  the  basis  of  MB/FH.  If  there  is  no 
direct  relationship  between  manhours  and  flying  hours,  the 
choice  of  this  statistic  for  analysis  and  comparison  may  be 
inappropriate  and  misleading. 

2.  Further  investigate  the  distribution  of  unscheduled 
manhours  per  aircraft.  This  research  study  considered  only 
one  system,  on  one  aircraft  model,  at  one  base.  Further 
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research  and  more  data  analysis  is  required  to  determine  if 
other  systems  and  other  aircraft  exhibit  the  same  apparent 
distribution  of  manhours  per  aircraft,  if  manhours  per  air¬ 
craft  follow  a  known  distribution,  then  perhaps  it  would  be 
a  more  appropriate  statistic  than  manhours  per  flying  hour. 


APPENDIX  A:  Manhour  Calculation  Program 


PROGRAM  MANHRS 

INTEGER  CREW (500) ,  RECNUM,  SERNUM ( 500 ), YEAR  ,J 
REAL  END , START ,TMNHRS , MNHRS (500) , TOTAL 
INTEGER  STOPl (500) ,STOP2(500) ,START1(500) ,START2(500) 
CHARACTER  MONTH* 3 ,  WUC*5,TYPE*9 
C  TOTAL  ■  TOTAL  MANHOURS 

C  T MNHRS  »  TOTAL  MANHOURS  FOR  EACH  AIRCRAFT 

C  CREW  -  CREW  SIZE 

C  RECNUM  -  NUMBER  OF  RECORDS 

C  SERNUM  -  LAST  FOUR  OF  AIRCRAFT  SERIAL  NUMBER 

C  END  «  STOPTIME  IN  MINUTES 

C  START  -  START  TIME  IN  MINUTES 

C  MNHRS  -  MANHOURS  FOR  ONE  MDC  RECORD 
C  STOPl  ■  STOP  TIME  HOURS 

C  STOP2  »  STOP  TIME  MINUTES 

C  START1  -  START  TIME  HOURS 

C  START2  -  START  TIME  MINUTES 

C  MONTH  -  MONTH  IN  WHICH  DATA  COLLECTED 

C  WUC  -  WORK  UNIT  CODE 

C  TYPE  ■  TYPE  MAINTENANCE 

MONTH-' AAA' 

WUC-'XXXXX' 

TYPE- 1 SSSSSSSSS ' 

YE/Ji-9999 
TOTAL- 0.0 
TMNHRS-0 . 0 
J-0 

RECNUM-0 

END-0. 

START-0 . 

DO  100  1-1,500 
START1 (I) -0 
START2 (I ) -0 
STOPl (I) -0 
STOP2 (I ) -0 
CREW(I) -0 
MNHRS (I) >0.0 
SERNUM (I) -0 
100  CONTINUE 

OPEN (9 ,FILE»' A85XOF ' , FORM- ' FORMATTED ' ) 

OPEN (10, FILE-' DATA' , FORM-' FORMATTED' ) 

REWIND  9 

READ (9,15) RECNUM , MONTH , YE AR , WUC , TYPE 

READ(9, 80, END-500) (SERNUM(I) ,START1(I) ,START2(I) 

C  STOPl (I),  STOP2 (I ) , CREW ( I ) ,  1-1, RECNUM) 

500  WRITE (10,14) 

WR ITE ( 1 0 , 5 ) MONTH , YE AR , WUC , TYPE 
WRITE (10,10) 
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WRITE (10,20) 

DO  600  1*1 ,RECNUM 

IF (STOP1 (I) . LT . START 1 ( I ) ) THEN 
STOP1 ( I ) *STOPl ( I )  +  24.0 
END  IF 

END-STOP1 ( I ) *60 . +STOP2 ( I ) 

START*START1 (I)*60.+  START2(I) 

MNHRS (I) “ ( ( END-START) /60 . ) *CREW ( I ) 

IF(STOPl(I) .GT.24.0)  THEN 
STOP1 ( I ) -STOP1 ( I ) -24 . 0 
END  IF 

WRITE  (10,30) 3ERNUM (I) ,START1(I) ,START2(I) ,STOPl(I) , 
C  STOP2 (I) /CREW (I) , MNHRS (I) 

J-J+l 

IF  ( J  .EQ.  40 ) THEN 
WRITE  (10/14) 

WRITE (10,5) MONTH / YEAR , WUC /TYPE 
WRITE (10,10) 

WRITE (10,20) 

J-0 
END  IF 

600  CONTINUE 
J-0 

WRITE (10,14) 

WRITE (10,5) MONTH , YEAR , WUC /TYPE 
WRITE (10,40) 

WRITE (10,50) 

DO  700  I-l/RECNUM 

TMNHRS-TMNHRS  +  MNHRS (I) 

IF(SERNUM(I) .EQ.SERNUM(I+1) )GO  TO  700 
WRITE(10,60)SERNUM(I) /TMNHRS 
TOTAL-TOTAL  +  TMNHRS 
J-J+l 

IF ( J  .EQ.  40) THEN 
WRITE (10,14) 

WR ITE ( 1 0  7  5 ) MONTH , YE AR , WUC , TYPE 
WRITE (10,40) 

WRITE (10,50) 

J-0 
END  IF 
TMNHRS-0 . 0 
700  CONTINUE 

WRITE (10, 90)  TOTAL 

5  FORMAT ( '  ' /A3/2X/I4,3X/A5/2X/A9) 

10  FORMAT ( '0' ,15X, 'MANHOURS  BY  RECORD') 

15  FORMAT ( 13, IX , A3, IX, 14, IX, A5, IX, A9) 

14  FORMAT (' 1 ',' MONTH  YEAR  WUC  TYPE  MAINTENANCE' ) 

20  FORMAT ( '0' , 'SERIAL  NUM  STARTTIME  STOPTIME  CREW  MAN 
C  HOURS’ ) 

30  FORMAT ( '  ' ,3X,I4,5X,I2,1X,I2,5X,I2,1X,  I2,5X,I1,5X  , 

C  F8.2) 

40  FORMAT ( '0' ,5X, 'MANHOURS  BY  SERIAL  NUMBER’) 
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50  FORMAT (’a’,' SERIAL  NUM  TOTAL  HOURS') 
60  FORMAT ( '  ' ,3X,I4,6X,F8. 2) 

80  FORMAT (14, IX, 12, IX, 12, IX, 12, IX, 12, IX, II) 

90  FORMAT ( '0* , 'GRAND  TOTAL' ,2X,F8.2) 

STOP 

END 
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Unscheduled  Manhours  WUC  74XXX 


Serial 

Number 

Nov 

Dec 

Jan 

Feb 

Mar 

Apr 

0543 

39.83 

33.83 

0.00 

6.00 

40.00 

24.75 

0544 

18.00 

0.00 

0.00 

14.83 

21.92 

42.08 

0545 

23.75 

5.83 

16.00 

7.00 

68.17 

36.33 

0546 

0.00 

14.00 

0.00 

16.00 

25.50 

40.83 

0555 

16.00 

0.00 

0.00 

0.00 

11.00 

35.75 

0556 

1.00 

0.00 

12.00 

8.50 

92.35 

28.00 

0559 

24.00 

12.00 

0.17 

24.00 

32.00 

48.33 

0561 

0.00 

7.50 

0.00 

28.00 

10.83 

35.00 

0574 

16.00 

37.83 

0.00 

0.00 

26.83 

97.67 

0576 

32.83 

13.50 

0.00 

0.00 

19.00 

24.25 

0585 

0.00 

8.00 

0.00 

0.00 

11.50 

37.00 

0587 

2.25 

29.00 

8.00 

61.75 

94.00 

37.25 

0588 

6.17 

26.50 

5.50 

22.00 

28.17 

88.83 

0589 

22.00 

7.00 

49.83 

24.12 

12.08 

8.33 

0590 

0.00 

0.00 

3.00 

17.25 

9.00 

0.00 

0592 

76.00 

96.00 

0.00 

13.50 

74.00 

44.25 

0601 

6.50 

30.00 

0.00 

102.50 

2.00 

54.33 

0602 

94.25 

18.00 

0.00 

22.00 

5.00 

0.00 

0604 

13.67 

6.00 

0.00 

4.00 

72.50 

141.42 

0605 

32.67 

31.00 

12.50 

24.00 

39.00 

41.67 

0606 

0.00 

0.00 

0.00 

28.00 

105.50 

0.00 

0607 

2.00 

15.67 

0.00 

78.00 

16.92 

12.00 

0608 

27.00 

0.00 

3.00 

22.00 

28.00 

6.00 

0612 

0.00 

21.83 

4.00 

1.33 

12.50 

36.67 

0613 

0.17 

2.50 

0.25 

3.00 

67.75 

27.92 

0614 

63.34 

11.00 

14.83 

0.00 

28.33 

25.25 

0615 

19.50 

29.00 

0.00 

3.00 

17.00 

0.00 

0618 

6.00 

10.33 

0.00 

0.00 

27.75 

24.42 

0620 

19.00 

12.00 

8.17 

41.00 

28.50 

0.00 

0622 

0.00 

21.83 

3.00 

0.00 

8.00 

6.00 

0665 

18.00 

10.50 

8.00 

47.83 

48.00 

32.75 

0666 

7.34 

0.00 

0.00 

28.17 

0.25 

0.00 

0669 

15.00 

33.50 

0.00 

29.50 

18.17 

0.00 

0671 

13.00 

6.50 

9.00 

38.00 

42.42 

16.32 

0672 

0.33 

0.00 

5.58 

3.67 

49.75 

77.08 

0673 

0.00 

12.00 

18.67 

0.00 

52.50 

56.75 

0674 

7.00 

14.00 

0.00 

12.00 

54.33 

53.00 

0680 

14.50 

34.00 

0.00 

229.17 

100.25 

57.50 

0681 

2.00 

4.00 

0.00 

49.63 

8.58 

77.50 

0694 

10.83 

0.00 

0.00 

14.00 

44.17 

0.00 

0695 

0.00 

6.00 

0.00 

11.00 

41.00 

54.91 
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Unscheduled  Manhours  WUC  74XXX 

Serial 


Number 

Nov 

Dec 

Jan 

Feb 

Mar 

Apr 

0697 

15.00 

23.00 

0.00 

17.33 

0.08 

26.00 

0698 

22.50 

34.50 

0.00 

0.00 

14.75 

31.33 

0699 

0.00 

15.50 

8.17 

41.00 

10.08 

9.00 

0700 

3.00 

36.75 

10.08 

2.00 

12.25 

31.17 

0707 

40.00 

0.00 

4.00 

100.00 

43.00 

12.00 

0709 

5.00 

18.00 

0.00 

49.50 

18.75 

3.00 

0710 

0.00 

19.50 

0.50 

29.33 

59.83 

49.50 

0711 

3.00 

26.00 

15.00 

20.00 

13.00 

1.50 

0712 

0.00 

52.83 

0.00 

7.75 

12.00 

11.92 

0713 

13.83 

28.00 

0.00 

0.00 

3.00 

0.00 

0721 

12.00 

19.00 

0.00 

0.00 

15.00 

0.00 

0722 

21.00 

13.00 

0.00 

89.08 

49.75 

0.00 

0723 

79.67 

47.00 

0.00 

26.50 

10.00 

32.33 

0731 

11.83 

32.50 

0.00 

13.00 

25.33 

31.58 

0732 

5.00 

8.08 

2.00 

0.00 

4.00 

0.00 

0737 

4.00 

0.00 

16.00 

14.42 

23.00 

0.00 

0738 

6.00 

13.42 

1.00 

20.50 

23.15 

7.50 

0757 

18.00 

9.00 

0.00 

34.50 

26.08 

4.00 

0758 

0.00 

2.50 

0.00 

4.00 

16.00 

11.33 

0759 

0.00 

0.00 

0.00 

0.00 

15.00 

73.17 
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Appendix  C:  Monthly  Manhour  Per  Aircraft  Histograms 


sweet  count  mean  st.dev. 

X  61  14.914  20.112 

EACH  STteOL  REPRESENTS  1  OBSERVATION 


FREQUENCY  PERCENTAGE 


#  OF  ACFT - >5  10  15  20  25  30  55  40  45  50  55 

INT. 

CUM. 

INT. 

CUM. 

*-3.0000  ♦ 

0 

0 

0.0 

0.0 

•0.00000  ♦xxxxxxxxxxxxxx 

14 

14 

23.0 

23.0 

•3.00000  +XXXXXXXX 

8 

22 

13.1 

36.1 

*6.00000  +XXXXX 

9 

27 

8.2 

44.3 

•9.00000  +XXXX 

4 

31 

6.6 

50.8 

•12.0000  +XXX 

3 

34 

4.9 

59.7 

•19.0000  *xxxxxx 

6 

40 

9.8 

69.6 

•18.0000  +XXXXX 

9 

49 

8.2 

73.8 

•21.0000  ♦XXX 

3 

48 

4.9 

78.7 

*24.0000  +XXXX 

4 

92 

6.6 

89.2 

•27.0000  «X 

1 

93 

1.6 

86.9 

*30.0000  ♦ 

0 

93 

0.0 

86.9 

•33.0000  +XX 

2 

99 

3.3 

90.2 

•36.0000  ♦ 

0 

99 

0.0 

90.2 

•39.0000  ♦ 

0 

99 

0.0 

90.2 

•42.0000  +XX 

2 

97 

3.3 

93.4 

•49.0000  ♦ 

0 

97 

0.0 

93.4 

•48.0000  ♦ 

0 

97 

0.0 

93.4 

•91.0000  ♦ 

0 

97 

0.0 

93.4 

•94.0000  ♦ 

0 

97 

0.0 

93.4 

*97.0000  ♦ 

0 

97 

0.0 

93.4 

•60.0008  ♦ 

0 

97 

0.0 

93.4 

*63.0000  ♦ 

0 

97 

0.0 

93.4 

•66.0000  *X 

1 

98 

1.6 

99.1 

•69.0000  + 

0 

98 

0.0 

99.1 

*72.0000  ♦ 

0 

98 

0.0 

99.1 

*79.0000  ♦ 

0 

98 

0.0 

99.1 

•78.0000  ♦X 

1 

99 

1.6 

96.7 

•81.0000  *X 

1 

60 

1.6 

98.4 

*84.0000  ♦ 

0 

60 

0.0 

98.4 

*87.0000  ♦ 

0 

60 

0.0 

98.4 

•90.0000  ♦ 

0 

60 

0.0 

98.4 

•93.0000  ♦ 

0 

60 

0.0 

98.4 

*96.0000  +X 

1 

61 

1.6 

100.0 

*99.0000  ♦ 

0 

61 

0.0 

100.0 

•102.000  ♦ 

0 

61 

0.0 

100.0 

*109.000  »■ . l - - - -  — «  -i  — - - -  . i - ; — 4 
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SYMBOL  COUNT  MEAN  ST.OEV. 

X  61  16.709  16.775 

EACH  SY1C0L  REPRESENTS  1  OBSERVATION 


FREQUENCY  PERCENTAGE 


i  OF  ACFT - -  5  10  15  20  25  30  35  40  45  50  55 

INT. 

CUM. 

INT. 

CIM. 

NWHMU  I  l  *  *  I  *  •  "  * 

••3.0000  ♦ 

0 

0 

0.0 

0.0 

•0.00000  •xxxxxxxxxxxx 

12 

12 

19.7 

19.7 

•3.00000  +XX 

2 

14 

3.3 

23.0 

•6.00000  txxxx 

4 

18 

6.6 

29.5 

•9.00000  +XXXXXX 

6 

24 

9.8 

39.3 

•12.0000  +XXXXXX 

6 

30 

9.8 

49.2 

•15.0000  +XXXXX 

5 

35 

8.2 

57.4 

•18.0000  -*XXXX 

4 

39 

6.6 

63.9 

•21.0000  +XX 

2 

41 

3.3 

67.2 

•24.0000  +XXX 

3 

44 

4.9 

72.1 

*27.0000  +XX 

2 

46 

3.3 

75.4 

*30.0000  +XXXX 

4 

50 

6.6 

82.0 

•33.0000  *XX 

2 

52 

3.3 

85.2 

•36.0000  +XXXX 

4 

56 

6.6 

91.8 

•39.0000  +XX 

2 

58 

3.3 

95.1 

•42.0000  + 

0 

58 

0.0 

95.1 

•45.0000  ♦ 

0 

58 

0.0 

95.1 

•48.0000  +X 

1 

59 

1.6 

96.7 

•51.0000  ♦ 

0 

59 

0.0 

96.7 

•54.0000  *X 

1 

60 

1.6 

98.4 

•57.0000  ♦ 

0 

60 

0.0 

98.4 

•60.0000  ♦ 

0 

60 

0.0 

98.4 

•63.0000  ♦  ^ 

0 

6C> 

0.0 

98.4 

•66.0000  ♦ 

0 

60 

0.0 

98.4 

•69.0000  ♦ 

0 

60 

0.0 

98.4 

•72.0000  ♦ 

0 

60 

0.0 

98.4 

•75.0000  ♦ 

0 

60 

0.0 

98.4 

•78.0000  ♦ 

0 

60 

0.0 

98.4 

•81.0000  ♦ 

0 

60 

0.0 

98.4 

•84.0000  ♦ 

0 

60 

0.0 

98.4 

•87.0000  ♦ 

0 

60 

0.0 

98.4 

•90.0000  + 

0 

60 

0.0 

98.4 

•93.0000  ♦ 

0 

60 

0.0 

98  4 

•96.0000  +X 

1 

61 

1.6 

100.0 

•99.0000  ♦ 

0 

61 

0.0 

100.0 

•102.000  ♦ 

0 

61 

0.0  100.0 

•105.000  ♦ 

0 

61 

0.0 

100.0 

•1C8.000  ♦ 

0 

61 

0.0 

100.0 

•Itl.OOO  ♦ 

0 

61 

0.0 

100.0 

•LAST  ♦ 

0 

61 

0.0 

100.0 
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SVMOL  COUNT  ICAN  ST.OEV. 

X  61  3.906  7.883 

EACH  SYMBOL  REPRESENTS  1  OBSERVATION 


§  OF  ACFT - -  3  10  19  20  29  30  39 

MMHOURS  >■  .  -* - 1  ♦  '  t 

*-3.0000  * 

*0.00000  +XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX 

•3.00000  +xxxxxxxx 

•6.00000  tXXXX 

*9.00000  +XXXXX 

•12.0000  +XX 

•19.0000  *XXX 

•18.0000  +XX 

•21.0000  +X 

•24.0000  ♦ 

•27.0000  ♦ 

•30.0000  ♦ 

•33.0000  ♦ 

•36.0000  ♦ 

*39.0000  ♦ 

•42.0000  ♦ 

•49.0000  ♦ 

•48.0000  ♦ 

•91.0000  *X 
•94.0000  ♦ 

•97.0000  ♦ 

•60.0000  ♦ 

•63.0000  ♦ 

•66.0000  ♦ 

•69.0000  ♦ 

*72.0000  ♦ 

•79.0000  ♦ 

•78.0000  ♦ 

•81.0000  ♦ 

•84.0000  ♦ 

•87.0000  ♦ 

•90.0000  ♦ 

•93.0000  ♦ 

•96.0000  ♦ 

•99.0000  ♦ 

•102.000  ♦ 

•109.000  ♦ 

•108.000  ♦ 

•111.000  ♦ 

•LAST  ♦ 


FREQUENCY  PERCENTAGE 
40  49  90  99  INT.  CUN.  I  NT.  CUN. 


0 

0 

0.0 

0.0 

39 

39 

97.4 

37.4 

8 

43 

13.1 

70.9 

4 

47 

6.6 

77.0 

9 

92 

8.2 

89.2 

2 

94 

3.3 

88.9 

3 

37 

4.9 

93.4 

2 

9 9 

3.3 

96.7 

1 

60 

1.6 

96.4 

0 

60 

0.0 

98.4 

0 

60 

0.0 

98.4 

0 

60 

0.0 

98.4 

0 

60 

0.0 

98.4 

0 

60 

0.0 

98.4 

0 

60 

0.0 

98.4 

0 

60 

0.0 

98.4 

0 

60 

0.0 

98.4 

0 

60 

0.0 

98.4 

1 

61 

1.6  100.0 

0 

61 

0.0  100.0 

0 

61 

0.0  100.0 

0 

61 

0.0  100.0 

0 

61 

0.0  100.0 

0 

61 

0.0  100.0 

0 

61 

0.0  100.0 

0 

61 

0.0  100.0 

0 

61 

0.0  100.0 

0 

61 

0.0  100.0 

0 

61 

0.0  100.0 

0 

61 

0.0  100.0 

0 

61 

0.0  100.0 

0 

61 

0.0  100.0 

0 

61 

0.0 

100.0 

0 

61 

0.0  100.0 

0 

61 

0.0 

100.0 

0 

61 

0.0  100.0 

0 

61 

0.0 

100.4 

0 

61 

0.0  100.0 

0 

61 

0.0 

100.0 

0 

61 

0.0 

100.0 
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sm  OOUMT  MEAN  ST  .DEV. 

X  61  24.653  36.09? 

EACH  S7WGL  REPRESENTS  t  OBSERVATION 


FREQUENCY  PERCENTAGE 

*  OF  ACFT - >  5  10  15  20  25  X  33  40  45  X  55  INT.  CUM.  INT.  CUM. 

.  _ _ _ _ a _ i _ a _ a _ a _ 'L _ a 

*-3.0000  ♦ 

0 

0 

0.0 

0.0 

*0.00000  ♦xxxxxxxxxxxxx 

13 

13 

21.3 

21.3 

*3.00000  +XXXX 

4 

17 

6*6 

27.9 

•6.00000  4XXXX 

4 

21 

6.6 

34.4 

*9.00000  ♦XXX 

3 

24 

4.9 

39.3 

*12.0000  *XX 

2 

26 

3.3 

42.6 

•15.0000  ♦XXXXX 

5 

31 

8.2 

50.8 

*18.0000  +XXX 

3 

34 

4.9 

55.7 

•21.0000  *XX 

2 

X 

3.3 

59.0 

•24.0000  ♦XXXXX 

5 

41 

8.2 

67.2 

•27.0000  *XX 

2 

43 

3.3 

X.5 

•30.0000  ♦XXXXX 

5 

46 

8.2 

78.7 

•33.0000  ♦ 

0 

48 

0.0 

78.7 

•36.0000  +X 

1 

49 

1.6 

89.3 

•39.0000  +X 

1 

50 

1.6 

82.0 

•42.0000  +XX 

2 

52 

3.3 

85.2 

•45.0000  ♦ 

0 

52 

0.0 

85.2 

*48.0000  *X 

1 

53 

1.6 

86.9 

•51.0000  *xx 

2 

35 

3.3 

90.2 

•54.0000  ♦ 

0 

55 

0.0 

90.2 

•57.0000  ♦ 

0 

55 

0.0 

90.2 

•60.0000  ♦ 

0 

55 

0.0 

90.2 

■63.0000  « 

1 

56 

1.6 

91.8 

•66.0000  ♦ 

0 

56 

0.0 

91.8 

•69.0000  ♦ 

0 

56 

0.0 

91.8 

*72.0000  ♦ 

0 

56 

0.0 

91.8 

*75.0000  ♦ 

0 

56 

0.0 

91.8 

*78.0000  *X 

1 

57 

1.6 

93.4 

•81.0000  ♦ 

0 

57 

0.0 

93.4 

•84.0000  ♦ 

0 

57 

0.0 

93.4 

*87.0000  ♦ 

0 

57 

0.0 

93.4 

•90.0000  *X 

1 

56 

1.6 

95.1 

*93.0000  ♦ 

0 

58 

0.0 

95.1 

•96.0000  ♦ 

0 

36 

0.0 

95.1 

•99.0000  ♦ 

0 

36 

0.0 

95.1 

•102.000  *X 

1 

59 

1.6 

96.7 

•105.000  *X 

1 

60 

1.6 

98.4 

•106.000  ♦ 

0 

60 

0.0 

98.4 

•111.000  ♦ 

0 

60 

0.0 

96.4 

•LAST  *X 

1 

61 

1.6  100.0 

5  10  15  2025X3540  45  505560 
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STOOL  COUNT  (CAN  ST.OEV. 

X  61  30.960  23.937 

EACH  STOOL  REPRESENTS  I  OBSERVATION 


FREQUENCY  PERCENTAGE 


i  OF  ACFT - >  9  10  19  20  29  30  39  40  49  90  99 

INT. 

CUN. 

INT. 

cm* 

MANHOURS  l  "»  *■  . - -*  — *— ♦ 

*-3. 0000  ♦ 

0 

0 

0.0 

0.0 

•0.00000  ♦ 

0 

0 

0.0 

0.0 

•3.00000  +XXXX 

4 

4 

6.6 

6.6 

•6.00000  «XX 

2 

6 

3.3 

9.8 

•9.00000  ♦XXX 

3 

9 

4.9 

14.8 

•12.0000  ♦XXXXXX 

6 

19 

9.8 

24.6 

•19.0000  +XXXXXXX 

7 

22 

11.9 

36.1 

•18.0000  «XX 

3 

29 

4.9 

41.0 

•21.0000  *XXX 

3 

28 

4.9 

49.9 

•24.0000  «XXX 

3 

31 

4.9 

90.8 

•27.0000  +XXXX 

4 

39 

6.6 

97.4 

•30.0000  tXXXXX 

9 

40 

8.2 

69.6 

•33.0000  «X 

1 

41 

1.6 

67.2 

•36.0000  ♦ 

0 

41 

0.0 

67.2 

•39.0000  « 

1 

42 

1.6 

68.9 

•42.0000  +XX 

2 

44 

3.3 

72.1 

•49.0000  ♦XXX 

3 

47 

4.9 

77.0 

•48.0000  «X 

1 

48 

1.6 

78.7 

•91.0000  +XX 

2 

90 

3.3 

82.0 

•94.0000  *X 

1 

91 

1.6 

83.6 

•97.0000  ♦* 

1 

92 

1.6 

89.2 

•60.0000  *X 

1 

93 

1.6 

86.9 

•63.0000  ♦ 

0 

93 

0.0 

86.9 

•66.0000  ♦ 

0 

93 

0.0 

86.9 

•69.0000  +XX 

2 

99 

3.3 

90.2 

*72.0000  ♦ 

0 

99 

0.0 

90.2 

•79.0000  *XX 

2 

97 

3.3 

93.4 

•78.0000  4 

0 

37 

0.0 

93.4 

•81.0000  4 

0 

37 

0.0 

93.4 

•84.0000  4 

0 

97 

0.0 

93.4 

•87.0000  4 

0 

97 

0.0 

93.4 

•90.0000  4 

0 

97 

0.0 

93.4 

•93.0000  4X 

1 

98 

1.6 

99.1 

•96.0000  4X 

1 

99 

1.6 

96.7 

•99.0000  4 

0 

99 

0.0 

96.7 

•102.000  4X 

1 

60 

1.6 

98.4 

•109.000  4 

0 

60 

0.0 

98.4 

•108.000  4X 

1 

61 

1.6  100.0 

•111.000  4 

0 

61 

0.0  100.0 

•LAST  4 

0 

61 

0.0  100.0 

+ 
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STOOL  COUNT  KAN  ST.OEV. 

X  61  28.992  28.763 

EACH  STOOL  REPRESENTS  I  OBSERVATION 


#  OF  ACFT - >  3  10  13  20  23  30  33  40  43  90  33 

FREQUENCY  PERCENTAGE 
INT.  CUN.  INT.  OM. 

*-3.0000  ♦ 

0 

0 

0.0  0.0 

*0.00000  +XXXXXXXXXXXXX 

13 

13 

21.3  21.3 

*3.00000  *XX 

2 

19 

3.3  24.6 

*6.00000  *XXX 

3 

18 

4.9  29.9 

•9.00000  ♦XXX 

3 

21 

4.9  34.4 

•12.0000  +XXXX 

4 

29 

6.6  41.0 

•19.0000  * 

0 

29 

0.0  41.0 

*18.0000  *X 

1 

26 

1.6  42.6 

•21.0000  ♦ 

0 

26 

0.0  42.6 

*24.0000  ♦ 

0 

26 

0.0  42.6 

*27.0000  +XXXXX 

9 

31 

8.2  90.8 

*30.0000  *XX 

2 

33 

3.3  94.1 

•33.0000  +XXXXX 

9 

38 

8.2  62.3 

*36.0000  *XX 

2 

40 

3.3  69.6 

•39.0000  «XXX 

4 

44 

6.6  72.1 

•42.0000  *XX 

2 

46 

3.3  79.4 

*49.0000  >XX 

2 

48 

3.3  78.7 

•48.0000  ♦ 

0 

48 

0.0  78.7 

•91.0000  *XX 

2 

90 

3.3  82.0 

•94.0000  +X 

1 

91 

1.6  83.6 

•97.0000  *XXX 

3 

94 

4.9  88.9 

•60.0000  *X 

1 

99 

1.6  90.2 

•63.0000  ♦ 

0 

99 

0.0  90.2 

*66.0000  ♦ 

0 

99 

0.0  90.2 

•69.0000  ♦ 

0 

99 

0.0  90.2 

*72.0000  ♦ 

0 

99 

0.0  90.2 

•79.0000  *X 

1 

96 

1.6  91.8 

•78.0000  4XX 

2 

98 

3.3  9;.i 

•81.0000  ♦ 

0 

98 

0.0  99.1 

*84.0000  + 

0 

98 

0.0  99.1 

•87.0000  ♦ 

0 

98 

0.0  99.1 

*90.0000  *X 

1 

99 

1.6  96.7 

•93.0000  ♦ 

0 

99 

0.0  96.7 

•96.0000  * 

0 

99 

0.0  96.7 

•99.0000  *X 

1 

60 

1.6  98.4 

•102.000  * 

0 

60 

0.0  98.4 

•109.000  ♦ 

0 

60 

0.0  98.4 

*108.000  * 

0 

60 

0.0  98.4 

*111.000  ♦ 

0 

60 

0.0  98.4 

•LAST  *X 

1 

61 

1.6  100.0 

9  10  19  2029303940  49  909960 
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Appendix  0 


Pooled  Manhours  Per  Aircraft  Histogram 


STOOL  COUNT  tCAN  ST.OEV. 

X  366  20.016  23.889 

EACH  X  STOOL  REPRESENTS  1  OBSERVATION 
EACH  #  SYMBOL  REPRESENTS  10  OBSERVATIONS 


FREQUENCY  PERCENTAGE 


t  OF  ACFT >  9  10  19  20  29  30  39  40  49  90  99 

manors  »■  — . .  ->  — .4— — <■ -»  -  >-  ♦— 1 

INT. 

CUM. 

INT. 

CLM. 

*-3.0000  ♦ 

0 

0 

0.0 

0.0 

*0.00000  ♦XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX#### 

87 

87 

23.8 

23.8 

•3.00000  *xxxxxxxxxxxxxxxxxxxxxxxxxxxx 

28 

119 

7.7 

31.4 

*6.00000  *xxxxxxxxxxxxxxxxxxxxxx 

22 

137 

6.0 

37.4 

*9.00000  ♦xxxxxxxxxxxxxxxxxxxxxxxx 

24 

161 

6.6 

44.0 

*12.0000  »xxxxxxxxxxxxxxxxxxxxxxx 

23 

184 

6.3 

90.3 

•15.0000  *xxxxxxxxxxxxxxxxxxxxxxxxxx 

26 

210 

7.1 

97.4 

•18.0000  «xxxxxxxxxxxxxxxxxx 

18 

228 

4.9 

62.3 

•21.0000  •xxxxxxxxxxx 

11 

239 

3.0 

65.3 

19 

294 

4.1 

69.4 

*27.0000  +XXXXXXXXXXXXXX 

14 

258 

3.8 

73.2 

*30.0000  ♦XXXXXXXXXXXXXXXX 

16 

284 

4.4 

77.6 

•33.0000  *xxoocaoaa 

10 

294 

2.7 

80.3 

*36.0000  >XXXXXXX 

7 

301 

1.9 

82.2 

•39.0000  +XXXXXXXX 

8 

309 

2.2 

84.4 

•42.0000  +XXXXXXXX 

8 

317 

2.2 

86.6 

•49.0000  >XXXXX 

9 

322 

1.4 

88.0 

•48.0000  *XXX 

3 

329 

.8 

88.8 

*91.0000  >XXXXXXX 

7 

332 

1.9 

90.7 

•94.0000  *XXX 

3 

339 

.8 

91.9 

*97.0000  ♦XXXX 

4 

339 

1.1 

92.6 

•60.0000  *XX 

2 

341 

.9 

93.2 

•63.0000  *X 

1 

342 

.3 

93.4 

•66.0000  *X 

1 

343 

.3 

93.7 

*69.0000  +XX 

2 

349 

.9 

94.3 

•72.0000  ♦ 

0 

349 

0.0 

94.3 

•79.0000  +XXX 

3 

348 

.8 

99.1 

•78.0000  4XXXX 

4 

392 

1.1 

96.2 

•81.0000  ♦X 

1 

393 

.3 

96.4 

•84.0000  ♦ 

0 

393 

0.0 

96.4 

*87.0000  ♦ 

0 

393 

0.0 

96.4 

*90.0000  +XX 

2 

399 

.9 

97.0 

•93.0000  *X 

1 

396 

.3 

97.3 

*96.0000  ♦XXX 

3 

399 

.8 

98.1 

•99.0000  *X 

1 

360 

.3 

98.4 

•102.000  *XX 

2 

362 

.9 

98.9 

♦ 
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Appendix  Es  Manhour  Paired  Difference  Histograms 


stool  count  mm  st.oev. 

X  61  *lt79S  20.520 

EACH  STOOL  REPRESENTS  1  OBSERVATION 


»  OF  ACFT - -  5  10  15  2025305540455055 

FREQUENCY  percentage 
INT.  OM.  INT.  CUM. 

*-49.000  *X 

1 

1 

1.6  1.6 

•-45. 500  ♦ 

0 

1 

0*0  1 *6 

o 

1 

•-42. 000  * 

o 

1 

0.0  1.6 

•-38. 500  ♦ 

o 

1 

•-35. 000  ♦ 

1 

o 

2 

1.6  3.3 

•>31.500  *X 

2 

0.0  3.3 

•>28.000  ♦ 

1 

3 

3 

1.6  4.9 

•>24.500  *X 

8 

8.2  13.1 

•>21.000  ♦XXXXX 
•-I7.500  +XXXXXX 

6 

14 

9.8  23.0 

3 

17 

4.9  27.9 

•>14.000  *XXX 

4 

21 

6.6  34.4 

•>10.500  +XXXX 
•>7.0000  4XXXXXXX 
•>3.5000  *XX 

7 

2 

28 

30 

11.5  45.9 
3.3  49.2 

•0.00000  *XXXXXXX 
•3.50000  ♦XXX 

7 

3 

37 

40 

11.5  60.7 
4.9  69.6 

•7.00000  +XXXX 

4 

44 

1 

•10.5009  *XXXXX 

5 

49 

6.2  80.3 

•14.0000  *XX 

2 

51 

43«6 

•17.5000  +XX 

2 

53 

3.3  86.9 

*21.0000  *XXX 

3 

56 

4.9  91.8 

*24.5000  ♦ 

0 

96 

0.0  91.8 

•28.0000  *X 

1 

57 

1.6  93.4 

•31.5000  ♦ 

0 

57 

0.0  93.4 

•39.0000  *X 

1 

58 

Wei 

•38.5000  ♦ 

0 

58 

0.0  99.1 

•42.0000  *X 

1 

59 

1.6  96.7 

•45.5000  * 

0 

59 

0.0  96.7 

•49.0000  ♦ 

0 

59 

0.0  96.7 

•52.5000  *X 

1 

60 

1.6  98.4 

•54.0000  ♦ 

0 

60 

0.0  98.4 

•59.5000  ♦ 

0 

60 

0.0  98.4 

•63.0000  ♦ 

0 

60 

0.0  98.4 

•66.5000  ♦ 

0 

60 

0.0  98.4 

•70.0000  ♦ 

0 

60 

0.0  98.4 

•73.5000  ♦ 

0 

60 

0.0  98.4 

•77.0000  *X 

1 

61 

1.6  100.0 

•80.5000  ♦ 

0 

61 

0.0  100.0 

5  10  15  20  29  30  55  40  45  50  55 _ 60 
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STOOL  COUNT  1CAN  ST.OEV. 

X  61  11.00  21.4*0 

EACH  STOOL  REPRESENTS  1  OBSERVATION 


» OF  ACFT— »  5  10  15  20  2S  30  39  40  49  90  99 

FREQUENCY  PERCENTAGE 
INT.  CUN.  1  NT.  CUM. 

•“28.000  ♦ 

0 

0 

0.0 

0.0 

•“24.900  4* 

1 

1 

1.6 

1.6 

••21.000  4 

0 

1 

0.0 

1.6 

•“17.900  +X 

1 

2 

1.6 

3.3 

•-14.000  4 

0 

2 

0.0 

3.3 

•-10.900  4XXX 

3 

9 

4.9 

8.2 

•-7. 0000  4XX 

2 

7 

3.3 

11.9 

••3.9000  ♦XXX 

3 

10 

4.9 

16.4 

•0.00000  ♦XXXXXXXXXXXX 

12 

22 

19.7 

36.1 

•3.90000  4XXXX 

4 

26 

6.6 

42.6 

•7.00000  4XXXXXX 

6 

32 

9.8 

92.9 

•10.9000  4XXX 

3 

39 

4.9 

97.4 

•14.0000  4XXXXXX 

6 

41 

9.8 

67.2 

*17.9000  4XXXXX 

9 

46 

8.2 

79.4 

•21.0000  4XXXXX 

5 

51 

8.2 

83.6 

•24.9000  4XXX 

3 

94 

4.9 

88.5 

•28.0000  ♦ 

0 

94 

0.0 

88.9 

•31.9000  4 

0 

94 

0.0 

88.9 

•39.0000  4X 

I 

99 

1.6 

90.2 

•38.9000  4X 

1 

96 

1.6 

91.8 

•42.0000  4X 

1 

57 

1.6 

93.4 

•49.9000  4 

0 

97 

0.0 

93.4 

•49.0000  4X 

1 

98 

1.6 

99.1 

•92.9000  ♦ 

0 

98 

0.0 

99.1 

•96.0000  ♦ 

0 

98 

0.0 

99.1 

•99.9000  4 

0 

98 

0.0 

99.1 

•63.0000  ♦ 

0 

98 

0.0 

99.1 

■66.9000  ♦ 

0 

98 

0.0 

99.1 

•70.0000  4 

0 

98 

0.0 

99.1 

•73.9000  ♦ 

0 

98 

0.0 

99.1 

•77.0000  *X 

1 

99 

1.6 

96.7 

•80.9000  *X 

1 

60 

1.6 

98.4 

•84.0000  ♦ 

0 

60 

0.0 

98.4 

•87.9000  * 

0 

60 

0.0 

98.4 

•91.0000  4 

0 

60 

0.0 

98.4 

•94.9000  4X 

1 

61 

1.6  100.0 

•98.0000  ♦ 

0 

61 

0.0  100.0 

•101.900  4 

0 

61 

0.0  100.0 

5  IO  II  20  D  X  JJ  «  O  JO  H  M 
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STOOL  COUNT  MEAN  ST.OEV. 

X  61  -9.799  40.916 

EACH  STOOL  REPRESENTS  1  OBSERVATION 


FREQUENCY  PERCENTAGE 


#  OF  ACFT — >  9  10  19  20  29  90  99  40  45  90  99 

INT. 

CUN. 

INT. 

CIM. 

*-206.00  *X 

1 

1 

1.6 

1.6 

*-200.00  ♦ 

0 

1 

0.0 

1.6 

•-I92.00  ♦ 

0 

1 

0.0 

1.6 

*-184.00  ♦ 

0 

1 

0.0 

1.6 

*-176.00  ♦ 

0 

1 

0.0 

1.6 

*-166.00  ♦ 

0 

1 

0.0 

1.6 

*-160.00  ♦ 

0 

1 

0.0 

1.6 

•-I 92.00  ♦ 

0 

1 

0.0 

1.6 

•-1 44.00  * 

0 

1 

0.0 

1.6 

•-196.00  ♦ 

0 

1 

0.0 

1.6 

*-128.00  ♦ 

0 

1 

0.0 

1.6 

*-'20.00  ♦ 

0 

1 

0.0 

1.6 

*-112.00  ♦ 

0 

1 

0.0 

1.6 

•-I04.00  ♦ 

0 

1 

0.0 

1.6 

*-96.000  *X 

1 

2 

1.6 

3.3 

*-66.000  ♦ 

0 

2 

0.0 

3.3 

•-60.000  ♦ 

0 

2 

0.0 

3.3 

*-72. 000  *X 

1 

3 

1.6 

4.9 

•-64. 000  *X 

1 

4 

1.6 

6.6 

*-96.000  >XX 

2 

6 

5.5 

9.6 

•-46.000  ♦ 

0 

6 

0.0 

9.8 

• -40. 000  +XXX 

3 

9 

4.9 

14.8 

*-32.000  ♦ 

0 

9 

0.0 

14.8 

*-24.000  *XXXXX 

9 

14 

6.2 

23.0 

*-16.000  +XXXXXX 

6 

20 

9.8 

32.8 

*-6. 0000  4XXXXX 

5 

29 

8.2 

41.0 

•0.00000  +XXXXXXXXXXXXXXXX 

16 

41 

26.2 

67.2 

*8.00000  +XXXXX 

5 

46 

8.2 

79.4 

•16.0000  4XXXXXX 

6 

92 

9.6 

89.2 

*24.0000  ♦XXX 

3 

99 

4.9 

90.2 

•32.0000  ♦ 

0 

99 

0.0 

90.2 

•40.0000  *XX 

2 

57 

3.3 

93.4 

•48.0000  * 

0 

57 

0.0 

93.4 

•96.0000  4X 

1 

96 

1.6 

99.1 

•64.0000  +XX 

2 

60 

3.3 

96.4 

•72.0000  ♦ 

0 

60 

0.0 

96.  4 

*60.0000  4X 

1 

61 

1.6 

100.0 

•88.0000  4 

0 

61 

0.0  100.0 

9  10  IS  20  29  30  99  40  49  SO  55  60 
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STOOL  COUNT  MEAN  ST.DEV. 

X  61  -16.046  33.096 

EACH  STOOL  REPRESENTS  1  OBSERVATION 


i  OF  ACFT— >  9  10  19  20  29  30  39  40  49  90  99 

MMMOURS  l  •  — f  »  *—  »  - 1  1  1  *——+ 

••114.00  ♦ 

*•106.00  * 

*-102.00  *X 
*-96.000  ♦ 

*-90.000  ♦XX 
*-64.000  *X 
*•78.000  ♦ 

*-72. 000  ♦ 

*-66.000  *X 
*•60.000  * 

*-94.000  *XX 
*•48.000  *XX 
*-42.000  *XX 
*•36.000  +X 
*•30.000  «XX 
*-24.000  *XXX 
*-18.000  «XX 
*•12.000  +XXXXXXXX 
*-6.0000  4XXXXXXXXXXXXX 
•0.00000  4XXXXXX 

*6.00000  ♦xxxxx 

•12.0000  *XXXX 
•18.0000  *XX 
•24.0000  ♦ 

•30.0000  ♦ 

•36.0000  *X 
•42.0000  ♦ 

•48.0000  ♦ 

•94.0000  ♦ 

•60.0000  ♦ 

•66.0000  ♦ 

•72.0000  *X 
•78.0000  ♦ 

•84.0000  ♦ 

•90.0000  *X 
•96.0000  ♦ 

•102.000  * 

•108.000  ♦ 


frequency  percentage 


INT. 

CUM. 

INT. 

CUM. 

0 

0 

0.0 

0.0 

0 

0 

0.0 

0.0 

1 

1 

1.6 

1.6 

0 

1 

0.0 

1.6 

2 

3 

3.3 

4.9 

1 

4 

1.6 

6.6 

0 

4 

0.0 

6.6 

0 

4 

0.0 

6.6 

1 

9 

1.6 

8.2 

0 

9 

0.0 

8.2 

2 

7 

3.3 

11.9 

2 

9 

3.3 

14.6 

2 

11 

3.3 

18.0 

1 

12 

1.6 

19.7 

2 

14 

3.3 

23.0 

3 

17 

4.9 

27.9 

3 

20 

4.9 

32.8 

8 

28 

13.1 

49.9 

13 

41 

21.3 

67.2 

6 

47 

9.8 

77.0 

9 

92 

6.2 

89.2 

4 

96 

6.6 

91.8 

2 

98 

3.3 

99.1 

0 

98 

0.0 

99.1 

0 

98 

0.0 

99.1 

1 

99 

1.6 

96.7 

0 

99 

0.0 

96.7 

0 

99 

0.0 

96.7 

0 

99 

0.0 

96.7 

0 

99 

0.0 

96.7 

0 

99 

0.0 

96.7 

1 

60 

1.6 

98.4 

0 

60 

0.0 

98.4 

0 

60 

0.0 

96.4 

1 

61 

1.6 

100.0 

0 

61 

0.0 

100.0 

0 

61 

0.0 

100.0 

0 

61 

0.0 

100.0 

3  10  IS  20  29  30  39  40  49  90  99  60 
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STOOL  COUNT  (CAN  ST.OEV. 
X  61  -14.038  36.449 

EACH  STOOL  REPRESENTS  1  OBSERVATION 


§  OF  ACFT - >  9  10  19  20  29  30  59  40  49  90  99 

FREQUENCY  PERCENTAGE 
INT.  CUM.  INT.  CUM. 

*-120.00  *X 

1 

1 

1.6  1.6 

*-114.00  ♦ 

0 

1 

0.0  1.6 

*-106.00  ♦ 

0 

1 

0.0  1.6 

*-102.00  ♦ 

0 

1 

0.0  1.6 

•-96. 000  ♦ 

0 

1 

0.0  1.6 

*-90.000  ♦ 

0 

1 

0.0  1.6 

•-84. 000  ♦ 

0 

1 

0.0  1.6 

•-78. 000  *XX 

2 

3 

3.3  4.9 

*-72.000  4XXX 

3 

6 

4.9  9.8 

*-66.000  ♦ 

0 

6 

0.0  9.8 

*-60.000  ♦ 

0 

6 

0.0  9.8 

*-54.000  4XX 

2 

8 

3.3  13.1 

*-48.000  *X 

1 

9 

1.6  14.8 

*-42.000  +XXX 

3 

12 

4.9  19.7 

*-36.000  4XXX 

3 

15 

4.9  24.6 

*-30.000  «ot 

2 

17 

3.3  27.9 

*-24.000  4XXXXX 

5 

22 

8.2  36.1 

•-1 8.000  *XXX 

3 

25 

4.9  41.0 

•-I 2.000  4XX 

2 

27 

3.3  44.3 

*-6.0000  4XXXXXXXX 

8 

35 

13.1  57.4 

•0.00000  4XXXX 

4 

39 

6.6  63.9 

*6.00000  ♦XXXX 

4 

43 

6.6  70.5 

•12.0000  +XXXX 

4 

47 

6.6  77.0 

*18.0000  4XXXXX 

5 

52 

8.2  85.2 

*24.0000  4XXXX 

4 

36 

6.6  91.8 

*30.0000  *X 

1 

57 

1.6  93.4 

•36.0000  *X 

1 

58 

1.6  95.1 

*42.0000  ♦* 

1 

39 

1.6  96.7 

•48.0000  « 

1 

60 

1.6  96.4 

•54.0000  ♦ 

0 

60 

0.0  98.4 

*60.0000  ♦ 

0 

60 

0.0  98.4 

*66.0000  ♦ 

0 

60 

0.0  98.4 

•72.0000  ♦ 

0 

60 

0.0  96.4 

•78.0000  ♦ 

0 

60 

0.0  98.4 

*84.0000  t 

0 

60 

0.0  98.4 

•90.0000  4 

0 

60 

0.0  98.4 

*96.0000  4X 

1 

61 

1.6  100.0 

•102.000  4 

0 

61 

0.0  100.0 

3  10  13  20  23  30  33  40  45  50  95  60 
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STOOL  COUNT  (CAN  ST.OEV. 

X  61  12.803  19.468 

EMH  STOOL  REPRESENTS  I  OBSERVATION 


t  OF  ACFT - >  9  10  15  20  29  30  39  40  49  90  99 

FREQUENCY  PERCENTAGE 
INT.  CM.  INT.  CUM. 

iiniuuru 

•-44*000 

♦ 

0 

0 

0.0 

0.0 

*-40.000 

♦X 

1 

1 

1.6 

1.6 

*-36.000 

♦ 

0 

1 

0.0 

1.6 

*-32.000 

♦ 

0 

1 

0.0 

1.6 

*-28.000 

♦ 

0 

1 

0.0 

1.6 

*-24.000 

♦ 

0 

1 

0.0 

1.6 

*-20-000 

♦ 

0 

1 

0.0 

1.6 

*-16.000 

•X 

1 

2 

1.6 

3.3 

*-12.000 

•X 

1 

3 

1.6 

4.9 

•-8. 0000 

♦X 

1 

4 

1.6 

6.6 

*-4. 0000 

♦XXX 

3 

7 

4.9 

11.5 

•0.00000 

•4.00000 

♦XXXXXXXXXX 

♦xxxxx 

10 

9 

17 

22 

16.4 

8.2 

27.9 

36.1 

•8.00000 

♦xxxxxx 

6 

28 

9.8 

45.9 

*12.0000 

♦xxxx 

4 

32 

6.6 

32.5 

•16.0000 

♦xxxxxx 

6 

38 

9.8 

62.3 

•20.0000 

♦xxxxxxx 

7 

49 

11.5 

73.8 

•24.0000 

♦XXX 

3 

48 

4.9 

78.7 

•28.0000 

♦XX 

2 

90 

3.3 

82.0 

•32.0000 

♦XX 

2 

92 

3.3 

89.2 

•36.0000 

♦xxxxx 

9 

97 

8.2 

93.4 

•40.0000 

♦X 

1 

98 

1.6 

99.1 

•44.0C00 

♦ 

0 

98 

0.0 

99.1 

•48.0000 

♦X 

1 

99 

1.6 

96.7 

•92.0000 

♦ 

0 

99 

0.0 

96.7 

•96.0000 

♦X 

1 

60 

1.6 

98.4 

•60.0000 

♦ 

0 

60 

0.0 

98.4 

•64.0000 

♦ 

0 

60 

0.0 

98.4 

•68.0000 

♦ 

0 

60 

0.0 

98.4 

•72.0000 

♦ 

0 

60 

0.0 

98.4 

•76.0000 

♦ 

0 

60 

0.0 

98.4 

•80.0000 

♦ 

0 

60 

0.0 

98.4 

•84.0000 

♦ 

0 

60 

0.0 

98.4 

•88.0000 

♦ 

0 

60 

0.0 

98.4 

*92.0000 

♦ 

0 

60 

0.0 

98.4 

•96.0000 

♦X 

1 

61 

1.6  100.0 

•100.000 

♦ 

0 

61 

0.0 

ioo.0 

•104.000 

♦ 

I  t  I  I  ■■■>  ■  >  — 4  ■'  t  (  »  ■  1  »■ 

0 

61 

0.0  100.0 

9  10  19  20  23  30  39  40  45  90  95  60 
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STOOL  COUNT  1CAN  ST. DEV. 

X  61  -7.949  38.689 

EACH  STOOL  REPRESENTS  1  OBSERVATION 


§  OF  ACFT— >  9  10  19  20  29  30  39  40  49  90  99 

MANHOURS  - - - - l - 1 - »  —  I  - - -  1  1  1  1 

•-192.00  *X 
*-184.00  ♦ 

*-176.00  ♦ 

*-168.00  ♦ 

•-1 60.00  ♦ 

*-192.00  ♦ 

•-I 44.00  ♦ 

*-136.00  ♦ 

•-I 28.00  * 

*-120.00  ♦ 

•-I 12.00  * 

*-104.00  ♦ 

*-96.000  +X 
*-88.000  * 

•-80.000  ♦ 

*-72.000  +XX 
*-64.000  ♦ 

*-96.000  *X 
*-48.000  ♦ 

*-40.000  *X 
*-32. 000  +XX 
*-24.000  .XXXXXXX 
•-16.000  +XXXX 
•-8. 0000  4XXXXXX 
•0.00000  .xxxxxxxxxx 
•8.00000  4XXXXXXXX 
•16.0000  *XXXXX 
•24.0000  4XXXXX 
•32.0000  ♦XXX 
•40.0000  *XXX 
•48.0000  *X 
*96.0000  ♦ 

•64.0000  ♦ 

•72.0000  ♦ 

•80.0000  ♦ 

•88.0000  « 

*96.0000  ♦ 

•104.000  ♦ 


9  10  19  20  29  30  39  40  49  90  99 


FREQUENCY  PERCENTAGE 

INT. 

CUM. 

1  NT. 

CUM. 

1 

1 

1.6 

1.6 

0 

1 

0.0 

1.6 

0 

1 

OX 

1.6 

0 

1 

0.0 

1.6 

0 

1 

0.0 

1.6 

0 

1 

0.0 

1.6 

0 

1 

0.0 

1.6 

0 

1 

0.0 

1.6 

0 

1 

0.0 

1.6 

0 

1 

0.0 

1.6 

0 

1 

0.0 

1.6 

0 

1 

0.0 

1.6 

1 

2 

1.6 

3.3 

0 

2 

0.0 

3.3 

0 

2 

0.0 

3.3 

2 

4 

3.3 

6.6 

0 

4 

0.0 

6.6 

1 

9 

1.6 

8.2 

0 

9 

0.0 

8.2 

1 

6 

1.6 

9.8 

2 

8 

3.3 

13.1 

7 

19 

11.9 

24.6 

4 

19 

9.6 

31.1 

6 

29 

9.8 

41.0 

10 

39 

16.4 

97.4 

8 

43 

13.1 

70.9 

9 

48 

8.2 

7C.7 

9 

93 

8.2 

86.9 

3 

56 

4.9 

91.8 

3 

99 

4.9 

96.7 

1 

60 

I.C 

98.4 

0 

60 

0.0 

98.4 

0 

63 

0.0 

98.4 

0 

60 

0.0 

98.4 

0 

60 

0.0 

98.4 

1 

61 

1.6 

100.0 

0 

61 

o 

« 

o 

100.0 

0 

61 

0.0 

100.0 

60 
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SYTeCL  COUNT  1CAM  ST.OEV. 

X  61  -14.251  30.814 

EACH  SY*e<X.  REPRESENTS  I  OBSERVATION 


frequency  PERCENTAGE 


§  OF  ACFT - >  3  10  13  20  25  30  33  40  45 

0  33 

INT. 

CUM. 

INT. 

CUM. 

•-100*00  *x 

1 

1 

1.6 

1.6 

*-96.000  + 

0 

1 

0.0 

1.6 

*-92.000  >X 

1 

2 

1.6 

3.3 

•-68.000  ♦ 

0 

2 

0.0 

3.3 

*-84.000  «• 

0 

2 

0.0 

3.3 

*-80.000  ♦ 

0 

2 

0.0 

3.3 

•-76. 000  * 

0 

2 

0.0 

3.3 

*-72.000  ♦ 

0 

2 

0.0 

3.3 

*-68.000  ♦ 

0 

2 

0.0 

3.3 

*-64.000  ♦xxa 

4 

6 

6.6 

9.8 

*-60.000  +X 

1 

7 

1.6 

11.5 

*-36.000  ♦ 

0 

7 

0.0 

11.5 

*-32.000  ♦ 

0 

7 

0.0 

11.3 

*-48.000  +X 

1 

8 

1.6 

13.1 

*-44.000  *X 

1 

9 

1.6 

14.8 

*-40.000  +XXXX 

4 

13 

6.6 

21.3 

•—36.000  *XX 

2 

13 

3.3 

24.6 

*-32.000  >XX 

2 

17 

3.3 

27.9 

*-28.000  *X 

1 

18 

1.6 

29.3 

*-24.000  ♦ 

0 

18 

0.0 

29.3 

*-20.000  +XXX 

3 

21 

4.9 

34.4 

*-16.000  +XXXX 

4 

23 

6.6 

41.0 

*-1 2.000  *XX 

2 

27 

3.3 

44.3 

•-8. 0000  +XXXXX 

3 

32 

9.2 

52.5 

*-4.0000  4-XXXX 

4 

36 

6.6 

39.0 

*0.00000  ♦XXXXXX 

6 

42 

9.8 

68.9 

•4.00000  *X 

1 

43 

1.6 

70.5 

•8.00000  fXXX 

3 

46 

4.9 

73.4 

*12.0000  +XXX 

3 

49 

4.9 

80.3 

•16.0000  +XXXX 

4 

33 

6.6 

86.9 

*20.0000  *X 

1 

34 

1.6 

88.3 

•24.0000  +XX 

2 

36 

3.3 

91.8 

*28.0000  tXXX 

3 

59 

4.9 

96.7 

•32.0000  ♦ 

0 

59 

0.0 

96.7 

•36.0000  ♦ 

0 

39 

0.0 

96.7 

•40.0000  +X 

1 

60 

1.6 

98.4 

•44.0000  *X 

1 

61 

1.6 

100.0 

•48.0000  ♦ 

0 

61 

O 

• 

o 

100.0 

5  10  15  20  25  30  35  40  45  50  55  60 
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STOOL  COUNT  ICAN  ST.DEV. 
X  61  -12.243  32.106 

EACH  STOOL  REPRESENTS  1  OBSERVATION 


§  OF  ACFT - -  5  10  19  20  25  30  35  40  45  30  59 

FREQUENCY  PERCENTAGE 
INT.  CUM.  INT.  CIM. 

*-1 44.00  ♦ 

0 

0 

0.0 

0.0 

*-138.00  ♦ 

0 

0 

0.0 

0.0 

*-132.00  +X 

1 

1 

1.6 

1.6 

*-126.00  ♦ 

0 

1 

0.0 

1.6 

*-120.00  ♦ 

0 

1 

0.0 

1.6 

•-1 14.00  ♦ 

0 

1 

0.0 

1.6 

*-108.00  ♦ 

0 

1 

0.0 

1.6 

*-102.00  + 

0 

1 

0.0 

1.6 

*-96.000  ♦ 

0 

1 

0.0 

1.6 

*-90.000  ♦ 

0 

1 

0.0 

1.6 

•-84.000  ♦ 

0 

1 

0.0 

1.6 

*-78.000  ♦ 

0 

1 

0.C 

1.6 

*-72.000  +XXX 

3 

4 

4.9 

6.6 

*-66.000  ♦ 

0 

4 

0.0 

6.6 

*-60.000  «X 

1 

9 

1.6 

8.2 

*-94.000  *X 

1 

6 

1.6 

9.8 

*-48.000  +X 

1 

7 

1.6 

11.9 

*-42.000  +XX 

2 

9 

3.3 

14.8 

*-36.000  +XX 

2 

11 

3.3 

18.0 

*-30.000  *XXX 

3 

14 

4.9 

23.0 

*-24.000  *XXXXXX 

6 

20 

9.8 

32.8 

*->8.000  +XX 

2 

22 

3.3 

36.1 

*-12.000  +XXXX 

4 

26 

6.6 

42.6 

*-6.0000  *XXXXXX 

6 

52 

9.8 

32.9 

*0.00000  +XXXXXXX 

7 

39 

11.9 

63.9 

*6.00000  +XXXXXX 

6 

49 

9.8 

73.8 

•12.0000  *XXXX 

4 

49 

6.6 

80.3 

*18.0000  *XXXXX 

5 

94 

8.2 

88.9 

•24.0000  4X 

1 

33 

1.6 

90.2 

*30.0000  +XXX 

3 

98 

4.9 

99.1 

•36.0000  +X 

1 

99 

1.6 

96.7 

•42.0000  +X 

1 

60 

1.6 

98.4 

•48.0000  ♦ 

0 

60 

0.0 

98.4 

*94.0000  +X 

1 

61 

1.6  1 

100.0 

*60.0000  ♦ 

0 

61 

0.0  1 

100.0 

*66.0000  ♦ 

0 

61 

0.0  100.0 

•72.0000  ♦ 

0 

61 

0.0  1 

100.0 

*78.0000  ♦ 

0 

61 

0.0  100.0 

♦- 


3  10  19  20  29  30  39  40  45  90  55  60 
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ST. DEV. 
37.402 
OBSERVATION 


STOOL  COUNT  ICAN 
X  61  -20.748 

EACH  STOOL  REPRESENTS  I 


#  OF  ACFT - >  9  10  13  20  23  30  39  40  45  30  99 

FREQUENCY  PERCENTAGE 
■  NT.  CUN.  INT.  CU(. 

*-224.00  *X 

1 

1 

1.6 

1.6 

*••217.00  ♦ 

0 

1 

0.0 

1.6 

•-2 10. 00  ♦ 

0 

1 

0.0 

1.6 

*-203.00  ♦ 

0 

1 

0.0 

1.6 

*-196.00  ♦ 

0 

1 

0.0 

1.6 

*-189.00  ♦ 

0 

1 

0.0 

1.6 

*-182.00  ♦ 

0 

1 

0.0 

1.6 

*-179.00  ♦ 

0 

1 

0.0 

1.6 

*-168.00  ♦ 

0 

1 

0.0 

1.6 

*-161.00  ♦ 

0 

1 

0.0 

1.6 

*-194.00  * 

0 

1 

0.0 

1.6 

*-147.00  ♦ 

0 

1 

0.0 

1.6 

*-140.00  4 

0 

1 

0.0 

1.6 

*-133,00  ♦ 

0 

1 

0.0 

1.6 

*-126.00  * 

0 

1 

0.0 

1.6 

•-1 19.00  ♦ 

0 

1 

0.0 

1.6 

•-1 12.00  ♦ 

0 

1 

0.0 

1.6 

*-109.00  ♦ 

0 

1 

0.0 

1.6 

*-98.000  +X 

1 

2 

1.6 

3.3 

*-91.000  *X 

1 

3 

1.6 

4.9 

*-64.000  >X 

1 

4 

1.6 

6.6 

•-77. 000  *X 

1 

3 

1.6 

8.2 

*-70.000  ♦ 

0 

9 

0.0 

8.2 

*-63.000  ♦ 

0 

9 

0.0 

8.2 

*-96.000  ♦ 

0 

3 

C.0 

8.2 

*-49.000  *XXX 

3 

8 

4.9 

13.1 

*-42.000  ♦ 

0 

8 

0.0 

13.1 

*-39.000  «X 

1 

9 

1.6 

14.8 

*-28.000  4XXXXXXXXX 

9 

18 

14.8 

29.9 

*-2. .000  +XXX 

3 

21 

4.9 

34.4 

*-14.000  4XXXXXXXX 

8 

29 

13.1 

47.5 

*-7.0000  4XXXXXX 

6 

39 

9.8 

97.4 

*0.00000  ♦xxxxxxxxxxxxxxx 

19 

90 

24.6 

82.0 

*7.00000  4XXXXXX 

6 

56 

9.8 

91.8 

•14.0000  +XX 

2 

98 

3.3 

99.1 

•21.0000  *XX 

2 

60. 

3.3 

98.4 

*28.0000  4X 

1 

61 

1.6  100.0 

•39.0000  ♦ 

0 

61 

0.0  100.0 

9  10  19  20 

29  30  39  40  49 

90 

99  60 
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STOOL  COUNT  KAN  ST.OEV. 

X  61  -27.094  26.671 

EACH  STWCL  REPRESENTS  I  OBSERVATION 


#  OF  AOFT - -  9  10  19  20  29  90  99  40  49  90  99 

FREQUENCY  PERCENTAGE 
INT.  CUN.  INT.  Cm. 

*-104.00  *X 

1 

1 

1.6 

1.6 

*-100.00  *X 

1 

2 

1.6 

3.3 

•46.000  ♦ 

0 

2 

0.0 

3.3 

*-92.000  ♦ 

0 

2 

0.0 

3.3 

*-66.000  ♦ 

0 

2 

0.0 

3.3 

•-64. 000  +X 

1 

3 

1.6 

4.9 

*-00.000  *X 

1 

4 

1.6 

6.6 

*-76.000  ♦ 

0 

4 

0.0 

6.6 

*-72.000  *XX 

2 

6 

3.3 

9.8 

*-66.000  * 

0 

6 

0.0 

9.8 

*-64.000  +X 

1 

7 

1.6 

11.9 

*-60.000  ♦ 

0 

7 

0.0 

11.9 

*-96.000  +X 

1 

8 

1.6 

13.1 

*-92.000  +XX 

2 

10 

3.3 

16.4 

*-46.000  +X 

1 

11 

1.6 

18.0 

*-44.000  +XX 

2 

13 

3.3 

21.3 

*-40.000  ♦XXX 

3 

16 

4.9 

26.2 

*-96.000  *X 

1 

17 

1.6 

27.9 

*-92.000  4XX 

2 

19 

3.3 

31.1 

*-28.000  ♦X 

1 

20 

1.6 

32.8 

*-24.000  ♦XXXXXXX 

7 

27 

11.9 

44.3 

*-20.000  ♦XXXX 

4 

31 

6.6 

90.8 

•-16.000  ♦XXXXXX 

6 

37 

9.8 

60.7 

*-12.000  ♦XXXXX 

9 

42 

8.2 

68.9 

-  6,0000  ♦XXXXXX 

6 

48 

9.8 

78.7 

*-4.0000  ♦XXXX 

4 

92 

6.6 

89.2 

*0.00000  ♦XXXXXXX 

7 

99 

11.9 

96.7 

•4.00000  ♦X 

1 

60 

1.6 

98.4 

•8.00000  ♦ 

0 

60 

0.0 

98.4 

•12.0000  ♦ 

0 

60 

0.0 

98.4 

*16.0000  ♦ 

0 

60 

0.0 

98.4 

•20.0000  ♦ 

0 

60 

0.0 

98.4 

•24.0000  ♦ 

0 

60 

0.0 

98.4 

•28.0000  ♦ 

0 

60 

0.0 

98.4 

•32.0000  ♦ 

0 

60 

0.0 

98.4 

•96.0000  ♦ 

0 

60 

0.0 

98.4 

•40.0000  *X 

1 

61 

1.6  100.0 

•44.0000  ♦ 

0 

61 

0.0  100.0 

♦ 


9  10  19  20299099  40  49  90  99  60 
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STOOL  COUNT  «AN  ST.OEV. 

X  61  -20.748  37.402 

EACH  STOOL  REPRESENTS  1  OBSERVATION 


t  or  acft — >  9  10  is  20  29  so  33  40  45  so  ss 

NNHUS  ♦— <-  . .  <  — »——»—♦——♦  >  ■-♦ 

*-224.00  ♦* 

*-217.00  ♦ 

*-210.00  ♦ 

*-203.00  ♦ 

*-196.00  ♦ 

*-189.00  ♦ 

*-182.00  ♦ 

*-179.00  ♦ 

*-168.00  ♦ 

*-161.00  ♦ 

*-194.00  ♦ 

*•147.00  ♦ 

•- 140-00  ♦ 

•-I33.00  ♦ 

*-126.00  ♦ 

*-119.00  ♦ 

*-112.00  ♦ 

*-109.00  ♦ 

*  98.000  *X  . 

*-91.000  *X 

*  81.000  *X 
*-77. 000  «X 
*-10.000  ♦ 

*-63.000  ♦ 

*-96.000  ♦ 

*-49.000  ♦XXX 
*-42.000  ♦ 

*-39.000  *X 
*-28.000  ♦XXXXXXXXX 
*-21.000  *XXX 
*-14.000  ♦XXXXXXXX 
•-7.0000  ♦XXXXXX 

•0.00000  ♦xxxxxxxxxxxxxxx 
*7.00000  ♦XXXXXX 
*14.0000  *XX 
•21.0000  *XX 
*28.0000  *X 
*39.0000  ♦ 


FREQUENCY  PERCENTAGE 
I  NT.  CUN.  I  NT.  CIM. 

1  1  1.6  1.6 
0  1  0.0  1.6 
0  I  0.0  1.6 

0  I  0.0  1.6 

0  1  0.0  1.6 
0  1  0.0  1.6 
0  1  0.0  1.6 
0  1  0.0  1.6 
0  1  0.0  1*6 
0  1  0.0  1.6 
0  1  0.0  1.6 
0  1  0.0  1.6 
0  1  0.0  1.6 
O  1  0.0  1.6 

0  1  0.0  1.6 
0  1  0.0  1.6 
0  1  0.0  1.6 
0  I  0.Q  1.6 

I  2  1.6  3.3 

1  3  1.6  4.9 

1  4  1.6  6.6 

1  9  1.6  8.2 

0  9  0.0  8.2 

0  9  0.0  8.2 

5  9  0.0  8.2 

3  8  4.9  13.1 

0  8  0.0  13.1 

1  9  1.6  14.8 

9  18  14.8  29.9 

3  21  4.9  34.4 

8  29  13.1  47.9 

6  39  9.8  97.4 

19  90  24.6  82.0 

6  96  9.8  91.8 

2  98  3.3  99.1 

2  60  3.3  98.4 

1  61  1.6  100.0 
0  61  0.0  100.0 
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snea.  count  ican  st.oev. 

X  61  -6.307  37.620 

EACH  Sima.  REPRESENTS  I  OBSERVATION 


»  OF  ACFT - >  9  10  19  20 

MmOURS  4- — »  ■> 

•  64.000  ♦ 

*“70.000  4X 
*•72.000  4X 
*-66.000  *X 
*-60.000  >XXX 
•-94.000  ♦ 

*-40.000  ♦X 
*-*2.000  4XX 
*-36.000  ♦ 

*-30  00  4XXXXX 
*-24.000  +XXX 
•-10.000  *X 
*-12.000  +XXXXXXX 

•-6. 0000  ♦loooooooooa 

•0.00000  4XXXXXX 

•6.00000  ♦ 

•12.0000  ♦XXXX 
•10.0000  4XXXXXX 
•24.0000  ♦ 

•30.0000  *X 
•36.0000  4XX 
•42.00 


29  30  39  40  49  90  99 


•94.0000  ♦ 
•60.0000  «X 
•66.0000  *X 
•72.0000  ♦ 
•70.0000  ♦ 
•04.0000  ♦ 
•90.0000  ♦ 
•96.0000  ♦ 
•102.000  *X 
•100.000  ♦ 
•114.000  ♦ 
•120.000  ♦ 
•126.000  ♦ 
•132.000  *X 
•130.000  ♦ 


9  10  19  2029303940499099 


FREQUENCY  PERCENTAGE 


INT. 

at*. 

INT 

.  CUN. 

0 

0 

0.0 

0.0 

i 

1.6 

1.6 

2 

1.6 

3.3 

3 

1.6 

4.9 

6 

4.9 

9.0 

6 

0.0 

9.6 

7 

1.6 

11.9 

9 

3.3 

14.8 

9 

0.0 

14.0 

14 

0.2 

23.0 

17 

4.9 

27.9 

10 

1.6 

29.9 

29 

11.9 

41.0 

11 

36 

10.0 

99.0 

42 

9.0 

66.9 

42 

0.0 

66.9 

46 

6.6 

79.4 

92 

9.0 

69.2 

92 

0.0 

89.2 

93 

1.6 

66.9 

99 

3.3 

90.2 

97 

3.3 

93.4 

97 

0.0 

93.4 

97 

0.0 

93.4 

90 

1.6 

99.1 

1 

99 

1.6 

96.7 

99 

0.0 

96.7 

99 

0.0 

96.7 

99 

0.0 

96.7 

99 

0.0 

96.7 

99 

0.0 

96.7 

1 

60 

1.6 

96.4 

60 

0.0 

96.4 

60 

0.0 

96.4 

60 

0.0 

96.4 

60 

0.0 

96.4 

61 

1.6  100.0 

61 

0.0  100.0 
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SYWOL  COUNT  KAN  ST.OEV. 

X  61  -4.299  46.124 

EACH  SYMBOL  REPRESENTS  I  OBSERVATION 


FREQUENCY  PERCENTAflE 


#  OF  ACFT— >  9  10  19  2029909940499099 

INT. 

CUM. 

INT. 

CUN. 

*-160.00  ♦ 

0 

0 

0.0 

0.0 

*-190.00  ♦ 

0 

0 

0.0 

0.0 

*-140.00  * 

0 

0 

0.0 

0.0 

*-*10.00  *X 

1 

1 

1.6 

1.6 

*-120.00  ♦ 

0 

1 

0.0 

1.6 

*-110.00  ♦ 

0 

1 

0.0 

1.6 

*-100.00  ♦ 

0 

1 

0.0 

1.6 

*-90.000  *X 

1 

2 

1.6 

3.3 

*  60.000  ♦ 

0 

2 

0.0 

3.3 

•-70.000  ♦XX 

2 

4 

9.9 

6.6 

*-60.000  *X 

1 

9 

1.6 

0.2 

*-90.000  *X 

1 

6 

1.6 

9.0 

•  40.000  *XX 

2 

• 

3.3 

13.1 

*-90.000  *XXXXX 

9 

19 

0.2 

21.3 

*-20.000  ♦XXXXXXXXXXX 

11 

24 

10.0 

39.3 

•-1 0.000  ♦xxxx 

4 

20 

6.6 

49.9 

*0*00000  +3000000001 

9 

97 

14.0 

60.7 

•10*0000  +x 

1 

90 

1.6 

62.3 

•20.0000  *xxxxxxxx 

• 

46 

13.1 

79.4 

•30*0000  +XXXXXX 

6 

92 

9.0 

09.2 

•40.0000  ♦« 

2 

94 

3.3 

80.9 

•90.0000  *XXX 

9 

97 

4.9 

99.4 

*60.0000  * 

0 

97 

0.0 

93.4 

•70.0000  *X 

1 

90 

1.6 

99.1 

•80.0000  ♦ 

0 

90 

0.0 

99.1 

•90.0000  *XX 

2 

60 

3.3 

90.4 

•100.000  ♦ 

0 

60 

0.0 

90.4 

•110.000  ♦ 

0 

60 

0.0 

90.4 

•120.000  ♦ 

0 

60 

0.0 

96.4 

•190.000  ♦ 

0 

60 

0.0 

90.4 

•140.000  ♦ 

0 

60 

0.0 

90.4 

•190.000  ♦ 

0 

60 

0.0 

90.4 

•160.000  ♦ 

0 

60 

0.0 

90.4 

•170.000  ♦ 

0 

60 

0.0 

98.4 

•100.000  *X 

1 

61 

1.6  100.0 

•190.000  ♦ 

0 

61 

0.0  100.0 

•200.000  ♦ 

0 

61 

0.0  100.0 

•210.000  ♦ 

0 

61 

0.0  100.0 
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SVMOL  COUNT  ST.OEV. 

X  61  2.006  22.829 

EACH  StWOL  REPRESENTS  I  OBSERVATION 


FREQUENCY  PERCENTAGE 


#  or  ACFT - >  9  10  19  20  29  20  29  40  49  90  99 

INT. 

CUN. 

INT. 

CUN. 

*-70.000  *X 

1 

1 

1.6 

1.6 

*-69.000  ♦XX 

2 

3 

3.3 

4.9 

*-60.000  *X 

1 

4 

1.6 

6.6 

*-99.000  *X 

1 

9 

1.6 

8.2 

*-90.000  *X 

1 

6 

1.6 

9.6 

•-49. 000  ♦ 

0 

6 

0.0 

9.8 

*-40.000  ♦ 

0 

6 

0.0 

9.6 

*-39.000  ♦ 

0 

6 

0.0 

9.6 

*-20.000  ♦ 

0 

6 

0.0 

9.6 

•-29. 000  *XXX 

3 

* 

4.9 

14.8 

*•20.000  ♦XXXXX 

9 

14 

6.2 

23.0 

•-I9.000  ♦XXXX 

4 

10 

6.6 

29.9 

•-IO.OCO  *x 

1 

19 

1.6 

31.1 

*-9.0000  «XX 

2 

21 

3.3 

34.4 

*0.00000  *xx 

2 

23 

3.3 

37.7 

•9.00000  ♦xxxxxxxxxxxxx 

13 

36 

21.3 

99.0 

•10.0000  «x 

1 

37 

1.6 

60.7 

•19.0000  ♦XXX 

3 

40 

4.9 

69.6 

•20*0000  ♦joooooc 

6 

46 

9.8 

79.4 

•29.0000  ♦XXX 

3 

49 

4.9 

60.3 

•20.0000  *XXX 

3 

92 

4.9 

69.2 

•39.0000  *XX 

2 

94 

3.3 

66.9 

•40.0000  *X 

1 

99 

1.6 

90.2 

•49.0000  *XX 

2 

97 

3.3 

93.4 

•90.0000  *X 

1 

90 

1.6 

99.1 

•99.0000  ♦ 

0 

96 

0.0 

99.1 

•60.0000  *X 

1 

99 

1.6 

96.7 

•69.0000  *X 

1 

60 

1.6 

96.4 

•70.0000  ♦ 

0 

60 

0.0 

96.4 

•79.0000  ♦ 

0 

60 

0.0 

96.4 

•80.0000  ♦ 

0 

60 

0.0 

96.4 

•89.0000  ♦ 

0 

60 

0.0 

96.4 

•90.0000  ♦ 

0 

60 

0.0 

96.4 

•99.0000  ♦ 

0 

60 

0.0 

96.4 

•100.000  ♦ 

0 

60 

0.0 

96.4 

•109.000  ♦ 

0 

60 

0.0 

96.4 

•110.000  *x 

1 

61 

1.6  100.0 

•119.000  ♦ 

0 

61 

0.0  100.0 

<■  4 
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This  -s^tKiy  explores  the  feasibility  of  using  statis¬ 
tical  sampling  techniques  in  lieu  of  a  census  to  collect 
Air  Force  maintenance  (MOC)  data.  A  practical  sampling 
methodology  is  identified  and  the  sample  size  required  to 
collect  data  with  a  specified  degree  of  statistical  pre¬ 
cision  is  illustrated.  The  variable  cost  of  MDC  data  col¬ 
lection  and  processing  is  also  identified.  Using  the  F-16A 
Fire  Control  System  on  the  aircraft  at  one  base  as  an 
example,  the  potential  cost  and  effort  savings  resulting 
from  sampling  are  evaluated.  ■ 

The  sampling  concept  is  based  on  a  simple  random  sam-  N 
pie  of  aircraft,  by  serial  number,  with  full  data  collect¬ 
ed  on  all  aircraft  in  the  sample.  The  sampling  plan  is 
designed  to  estimate  the  base  level  monthly  total  unsched¬ 
uled  maintenance  manhours  at  the  two  digit  work  unit  code 
level,  with  10  percent  relative  precision  and  90  percent 
confidence.  The  methodology  used  to  estimate  the  variable 
cost  of  collecting  and  processing  MOC  data  records  is 
limited  to  base  and  Air  Force  Logistics  Command  (AFLC) 
levels.  Base  level  costs  considered  are  the  opportunity 
cost  of  a  maintenance  technician's  time  to  enter  one  MDC 
record  into  an  automated  system  terminal,  and  the  cost  of 
computer  processing  and  transmission  of  data  to  AFLC.  AFLC 
costs  considered  are  the  machine  time  charges  assessed 
against  the  0056  Product  Performance  System. 

In  the  single  system  studied,  the  variability  in 
monthly  unscheduled  manhours  per  aircraft,  was  found  to  be 
high.  The  resulting  sample  size  required  to  estimate  man¬ 
hours  with  the  desired  degree  of  statistical  accuracy, 
based  on  the  greatest  observed  variability  in  historical 
data,  nearly  represents  a  census.  The  variable  cost  of 
collecting  and  processing  MOC  data  is  significant.  How¬ 
ever,  unless  a  sophisticated  technique  can  be  used  to  pre¬ 
dict  data  variability  and  reduce  the  required  sample  size, 
the  potential  cost  and  effort  savings  resulting  from  sam¬ 
pling  appear  to  be  minimal. 


